Blogs

Boost your throughput with dynamic batching

Modal

Learn how we used our new dynamic batching feature to improve throughput and reduce inference costs for the Whisper model with a single line of code!

Visit Site

Boost your throughput with dynamic batching
Best practices for serverless inferenceModal 8 Top Open-Source OCR Models Compared: A Complete GuideModal Google Cloud Run functions pricing: understanding costs and optimizationModal Fine-tuning a FLUX.1-dev style LoRAModal Azure Functions pricing: Consumption vs. Flex ConsumptionModal Glossary: LLM fine-tuning hyperparametersModal Pulumi ESC Table Editor Now Supports Dynamic Credential and Secret IntegrationsPulumi Product updates: Rollbacks, batching, sandbox tunnels & moreModal Jetpack Boost Handles Critical CSS For YouCss Tricks AMD and Cerebras Announce Disaggregated AI InferenceCerebras Bringing More Power To Edge Rules! Introducing Variable ExpansionBunny How to Use AI Image to Video Generator for Free to Create Dynamic VideosHeygen Meta AI Video Generator's ImpactHeygen How To Create and Use Avatars in eLearningHeygen Dynamic Data Capture Sets the Stage for Extreme PersonalizationThenewstack Improve Developer Experience: Increase Dev Productivity with Internal Developer PlatformsPulumi Introducing CDN Vary Cache By Cookie ValueBunny Bunny Network Tools are here. Test away at bunny.net!Bunny Maximize Sales with Ecommerce Video StrategiesHeygen The 6 best task automation tools in 2026Zapier