Blogs

Introducing Modal Auto Endpoints: Optimized inference you actually own

Modal

LLM inference at SotA speeds and Modal quality, now available to everyone.

Visit Site

Introducing Modal Auto Endpoints: Optimized inference you actually own
Best practices for serverless inferenceModal How much VRAM do I need for LLM inference?Modal 8 Top Open-Source OCR Models Compared: A Complete GuideModal Google Cloud Run functions pricing: understanding costs and optimizationModal Fine-tuning a FLUX.1-dev style LoRAModal Azure Functions pricing: Consumption vs. Flex ConsumptionModal Security Considerations for API-Driven Apps Deployed to CloudThenewstack Introducing CORPS: The 5 Pillars for a Robust Cloud Architecture FrameworkThenewstack Introducing New Slimmer Docker ImagesPulumi How to serve trillions of tokens for trillion-parameter coding agentsModal Introducing: H100s on ModalModal pg_duckdb: Splicing Duck and Elephant DNAMotherduck The Serverless Backend for Analytics: Introducing MotherDuck’s Native Integration on VercelMotherduck New Collaboration Features: Org-level sharing and Auto-JoinMotherduck The rise of slow personal assistantsCerebras Introducing DocChat: GPT-4 Level Conversational QA Trained In a Few Hours - CerebrasCerebras Simulating Human Behavior with Cerebras - CerebrasCerebras 100x Defect Tolerance: How Cerebras Solved the Yield Problem - CerebrasCerebras Cerebras Announces Six New AI Datacenters Across North America and Europe to Deliver Industry’sCerebras AMD and Cerebras Announce Disaggregated AI InferenceCerebras