Blogs

RedPajama training progress at 440 billion tokens

Together

A week ago we announced Red Pajama, a project to create leading open-source models. We released the first step in the project a training dataset of over 1.2 trillion tokens following the LLaMA recipe.

Visit Site

Together Fine-Tuning Platform, Now With Preference Optimization and Continued TrainingTogether Hyena Hierarchy: Towards larger convolutional language modelsTogether Kimi K3: the complete developer guideTogether How to choose the right open model for productionTogether Linearizing LLMs with LoLCATsTogether Together AI launches Llama 3.2 APIs for vision, lightweight models & Llama Stack: powering rapidTogether How we grew Mintlify by doing things that don't scaleMintlify The Most Important Work in AI Training Is Also the Most Overlooked - Deepgram Blog ⚡️Deepgram How to implement AI training for employeesZapier AI frameworks: Definition, types, and how to chooseZapier How to serve trillions of tokens for trillion-parameter coding agentsModal Cerebras Raises $1 Billion Series H at $23 Billion ValuationCerebras Accelerating GPT-5.6 Sol UltrafastCerebras The Livecycle Docker Extension: Instantly Share Changes and Get Feedback in ContextDocker Interactive Training Videos (+ How to Create One with AI)Synthesia How Beyond Retro scaled its retail operations trainingSynthesia How to Create an Online Training CourseSynthesia How Mondelez Accelerates Supply Chain Training Across 150+ Global Manufacturing PlantsSynthesia Twitch Browser Extension Exposes 30,000 Users’ OAuth Tokens to Russian Bot ServiceSocket Training: Hard Work Pays off for Data/AI ProsThenewstack