Research

INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge

Cohere

Nov 29, 2024 INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge In this work, we construct an evaluation suite of 197,243 QA pairs from local exam sources to measure the capabilities of multilingual LLMs in a variety of regional contexts.

Visit Site

Research Cohere

ResearchUnderstanding and Mitigating Language Confusion in LLMsCohere ResearchBigScience: A Case Study in the Social Construction of a Multilingual Large Language ModelCohere ResearchOne Tokenizer To Rule Them All: Emergent Language Plasticity via Multilingual TokenizersCohere ResearchInvestigating Continual Pretraining in Large Language Models: Insights and ImplicationsCohere ResearchScalable Data Ablation Approximations for Language Models through Modular Training and MergingCohere ResearchAya Vision: Multilingual Multimodal AI AdvancementsCohere Blogs10 best AI observability tools for monitoring and evaluating agents in 2026Mintlify BlogsTrained on 100,000+ Voices: Deepgram Unveils Next-Gen Speaker Diarization and Language DetectionDeepgram BlogsThe Language of LGBTQ Inclusion and Allyship - Deepgram Blog ⚡️Deepgram BlogsNew Spanish and Turkish Language Models and Updated General Models - Deepgram Blog ⚡️Deepgram NewsOData or GraphQL? The Best Tech for Developing an API Is Neither or Both!Thenewstack BlogsPkg.go.dev has a new look! - The Go Programming LanguageGo BlogsInside the Go Playground - The Go Programming LanguageGo BlogsReal Go Projects: SmartTwitter and web.go - The Go Programming LanguageGo BlogsThe App Engine SDK and workspaces (GOPATH) - The Go Programming LanguageGo BlogsGo on App Engine: tools, tests, and concurrency - The Go Programming LanguageGo ResourcesThe Go Memory Model - The Go Programming LanguageGo BlogsErrors are values - The Go Programming LanguageGo BlogsUsing Subtests and Sub-benchmarks - The Go Programming LanguageGo BlogsGodoc: documenting Go code - The Go Programming LanguageGo