Blogs

RedPajama-Data-v2: An open dataset with 30 trillion tokens for training large language models

Together

Today, we're releasing a new version of the Red Pajama dataset, with 30 trillion filtered and deduplicated tokens (100+ trillions raw) from 84 Common Crawl dumps covering 5 languages, along with 40+ pre-computed data quality annotations that can be used for further filtering and weighting.

Visit Site

Hyena Hierarchy: Towards larger convolutional language modelsTogether Large Reasoning Models Fail to Follow Instructions During Reasoning: A Benchmark StudyTogether Hungry Hungry Hippos: Towards language modeling with state space modelsTogether How to choose the right open model for productionTogether Together AI launches Llama 3.2 APIs for vision, lightweight models & Llama Stack: powering rapidTogether Together Fine-Tuning Platform, Now With Preference Optimization and Continued TrainingTogether Cloud Security Trends & Challenges: Complete GuideCybersecurity Exchange 10 best AI observability tools for monitoring and evaluating agents in 2026Mintlify Trained on 100,000+ Voices: Deepgram Unveils Next-Gen Speaker Diarization and Language DetectionDeepgram State of Speech: Our New Data Report Reveals ASR’s Untapped Potential - Deepgram Blog ⚡️Deepgram The Language of LGBTQ Inclusion and Allyship - Deepgram Blog ⚡️Deepgram Build a Presentation Coaching Application with Recall - Deepgram Blog ⚡️Deepgram 5 Reasons to Keep Contributing to Open-Source Projects - Deepgram Blog ⚡️Deepgram The Most Important Work in AI Training Is Also the Most Overlooked - Deepgram Blog ⚡️Deepgram New Spanish and Turkish Language Models and Updated General Models - Deepgram Blog ⚡️Deepgram Data Ingestion: 6 Ways to Speed Up Your ApplicationRedis How to implement AI training for employeesZapier AI frameworks: Definition, types, and how to chooseZapier 5 ways to automate Browse AIZapier How to connect Google Sheets to NotionZapier