Blogs

Achieve state-of-the-art inference latencies with speculative decoding

Modal

How Modal and Decagon worked together to cut inference latency - and you can too.

Visit Site

Achieve state-of-the-art inference latencies with speculative decoding
Best practices for serverless inferenceModal How much VRAM do I need for LLM inference?Modal 8 Top Open-Source OCR Models Compared: A Complete GuideModal Google Cloud Run functions pricing: understanding costs and optimizationModal Fine-tuning a FLUX.1-dev style LoRAModal Azure Functions pricing: Consumption vs. Flex ConsumptionModal State of Speech: Our New Data Report Reveals ASR’s Untapped Potential - Deepgram Blog ⚡️Deepgram Announcing the New Pulumi Partner ProgramPulumi Svelte for the Experienced React DevCss Tricks The rise of slow personal assistantsCerebras Real-Time Computational Physics with Wafer-Scale Processing [updated]Cerebras Simulating Human Behavior with Cerebras - CerebrasCerebras 100x Defect Tolerance: How Cerebras Solved the Yield Problem - CerebrasCerebras Cerebras Announces Six New AI Datacenters Across North America and Europe to Deliver Industry’sCerebras AMD and Cerebras Announce Disaggregated AI InferenceCerebras Cerebras Systems, Ranovus win $45 million US military deal to speed up chip connectionsCerebras Cerebras Systems Raises $250M in Funding for Over $4B Valuation to Advance the Future of ArtificialCerebras Memory snapshots: Checkpoint/restore for sub-second startupModal Speculation Is All You NeedModal State of DevSecOpsDatadoghq