Research

In-context learning and induction heads

Anthropic

We observe a sharp phase change early in training when induction heads form and in-context learning jumps, across models from 13M to 13B parameters.

Visit Site

Vibe physics: The AI grad studentAnthropic Towards measuring the representation of subjective global opinions in language modelsAnthropic Tracing the thoughts of a large language modelAnthropic An off switch for dual-use knowledgeAnthropic Red teaming language models to reduce harmsAnthropic AI agents find smart contract exploitsAnthropic Lessons Swift Designer Chris Lattner Has Learned about LeadershipThenewstack Go Concurrency Patterns: Context - The Go Programming LanguageGo Summer Data Engineering RoadmapMotherduck The Livecycle Docker Extension: Instantly Share Changes and Get Feedback in ContextDocker How To Create and Use Avatars in eLearningHeygen Rolling out a new featureVercel 6 tips every developer should know when using Cursor and Windsurf AIMintlify From Hawking to Siri: The Evolution of Speech SynthesisDeepgram How Sky Italia Digitizes Learning Paths to Accelerate New Product Launches by 4xSynthesia How EPOS achieved a 90% learning completition rate with AI video.Synthesia How Mondelez Accelerates Supply Chain Training Across 150+ Global Manufacturing PlantsSynthesia Training: Hard Work Pays off for Data/AI ProsThenewstack Breakdown: The Kubernetes-Run AI Video Generation Pipeline for NIUS.TVThenewstack Pulumi Context API: query your infrastructure as a graphPulumi