Blogs

SpecExec: Massively Parallel Speculative Decoding for Interactive LLM Inference on Consumer Devices

Together

We introduce Spec Exec, a new speculative decoding method that applies the classical approach of “speculative execution” to LLM inference.

Visit Site

Introducing AutoJudge: Streamlined inference acceleration via automated dataset curationTogether Learn how Cursor partnered with Together AI to deliver real-time, low-latency inference at scaleTogether Hyena Hierarchy: Towards larger convolutional language modelsTogether Kimi K3: the complete developer guideTogether How to choose the right open model for productionTogether Linearizing LLMs with LoLCATsTogether The rise of slow personal assistantsCerebras Simulating Human Behavior with Cerebras - CerebrasCerebras 100x Defect Tolerance: How Cerebras Solved the Yield Problem - CerebrasCerebras Cerebras Announces Six New AI Datacenters Across North America and Europe to Deliver Industry’sCerebras AMD and Cerebras Announce Disaggregated AI InferenceCerebras Cerebras Systems, Ranovus win $45 million US military deal to speed up chip connectionsCerebras Cerebras Systems Raises $250M in Funding for Over $4B Valuation to Advance the Future of ArtificialCerebras How to Create a Spokesperson on AI Video GeneratorHeygen 12 Best Uberduck Alternatives for AI Text-to-Speech GenerationHeygen How To Create and Use Avatars in eLearningHeygen AsyncAPI setup - MintlifyMintlify Interactive Training Videos (+ How to Create One with AI)Synthesia An Introduction to Using Linux in Embedded SystemsThenewstack Five Stacks Before Lunch: The Parallel Coding Playbook for PulumiPulumi