We’re releasing highly-optimized GPU kernels for an underexplored class of neural network architectures: networks with block-sparse weights. Depending on the chosen sparsity, these kernels can run orders of magnitude faster than cuBLAS or cuSPARSE. We’ve used them to attain state-of-the-art results in text sentiment analysis and generative modeling of text and images.

Recommended

Credit Saison achieves 954% ROI in a ChatGPT Enterprise pilotOpenai Making it easier for websites to express AI training preferencesOpenai Community safety report and new protections for teensOpenai Operation "Doppelganger": Russian influence activity targeting UkraineOpenai Everyday work with ChatGPT WorkOpenai Romance scams: AI-enabled romance scam workflowsOpenai What is a CUDA Thread Block?What is a CUDA Thread Block?Modal What is a Load/Store Unit?What is a Load/Store Unit?Modal Cerebras Systems Enables GPU-Impossible™ Long Sequence Lengths Improving Accuracy in NaturalCerebras Systems Enables GPU-Impossible™ Long Sequence Lengths Improving Accuracy in NaturalCerebras What is a Tensor Core?What is a Tensor Core?Modal GPU Memory Snapshots: Supercharging sub-second startupGPU Memory Snapshots: Supercharging sub-second startupModal Run GPU jobs from Airflow with ModalRun GPU jobs from Airflow with ModalModal Two-Value Display Syntax (and Sometimes Three)Two-Value Display Syntax (and Sometimes Three)Css Tricks Sparsity Made EasySparsity Made EasyCerebras Inside Modal Notebooks: How we built a cloud GPU notebook that boots in secondsInside Modal Notebooks: How we built a cloud GPU notebook that boots in secondsModal Context is Everything: Why Maximum Sequence Length Matters - CerebrasContext is Everything: Why Maximum Sequence Length Matters - CerebrasCerebras Accelerating Large GPT Training with Sparse Pre-Training and Dense Fine-Tuning [Updated] - CerebrasAccelerating Large GPT Training with Sparse Pre-Training and Dense Fine-Tuning [Updated] - CerebrasCerebras NVIDIA, RTXs, H100, and more: The Evolution of GPUNVIDIA, RTXs, H100, and more: The Evolution of GPUDeepgram How to Run AI Agents on Kubernetes with PulumiHow to Run AI Agents on Kubernetes with PulumiPulumi Gafgyt Malware Variant Exploits GPU Power and Cloud Native EnvironmentsGafgyt Malware Variant Exploits GPU Power and Cloud Native EnvironmentsAquasec