Blogs

Making FlashAttention-4 faster for inference

Modal

When the Flash Attention-4 kernel source was released last year, we dove in and shared our findings about how the kernel works in excruciating exquisite detail.

Visit Site

Making FlashAttention-4 faster for inference
Best practices for serverless inferenceModal How much VRAM do I need for LLM inference?Modal 8 Top Open-Source OCR Models Compared: A Complete GuideModal Google Cloud Run functions pricing: understanding costs and optimizationModal Fine-tuning a FLUX.1-dev style LoRAModal Azure Functions pricing: Consumption vs. Flex ConsumptionModal When CI Meets CD: Deliver With ConfidenceThenewstack Announcing the New Pulumi Partner ProgramPulumi Supporting Kubernetes with Faster, Easier Test EnvironmentsPulumi Automatic cipher suite ordering in crypto/tls - The Go Programming LanguageGo How a top tier European soccer team sped up their data processing and reduced costs by 50%Modal Introducing: H100s on ModalModal PostgreSQL and Ducks: The Perfect Analytical PairingMotherduck Revolutionizing Life Science and Healthcare with Generative AI - CerebrasCerebras The rise of slow personal assistantsCerebras Simulating Human Behavior with Cerebras - CerebrasCerebras 100x Defect Tolerance: How Cerebras Solved the Yield Problem - CerebrasCerebras Cerebras Announces Six New AI Datacenters Across North America and Europe to Deliver Industry’sCerebras AMD and Cerebras Announce Disaggregated AI InferenceCerebras Cerebras Systems, Ranovus win $45 million US military deal to speed up chip connectionsCerebras