Research

Privileged bases in the transformer residual stream

Anthropic

Individual coordinates in the residual stream show unexpected privileged basis behavior, provisionally attributed to Adam's per-dimension normalizers.

Visit Site

Privileged bases in the transformer residual stream
Vibe physics: The AI grad studentAnthropic Towards measuring the representation of subjective global opinions in language modelsAnthropic Tracing the thoughts of a large language modelAnthropic An off switch for dual-use knowledgeAnthropic Red teaming language models to reduce harmsAnthropic AI agents find smart contract exploitsAnthropic Duck Duck Stream: How to Efficiently Load Data into DuckLake with EstuaryMotherduck Multi-token Residual PredictionModal Improving video uploads: Introducing the Bunny Stream resumable & pre-signed APIBunny What is a HEIF image extension and what is it used for?Bunny Storage Structure - bunny.net DocumentationBunny Suno Breached via Shai-Hulud Worm, Leaked Code Exposes AI Music ScrapingSocket Introducing Transcribe AI for Bunny Stream!Bunny Cerebras Systems and Cirrascale Cloud Services® Introduce Cerebras AI Model Studio to TrainCerebras Bunny Stream Video CDN just reached 1 million videos!Bunny HTTP - bunny.net DocumentationBunny How Edge Storage powers Bunny Stream to offer unparalleled video delivery performanceBunny Introducing Bunny Stream: A better way to deliver online videoBunny 6 Ways Telehealth Platforms Can Leverage Speech-to-Text AIAssemblyai Build a real-time medical transcription analysis app with AssemblyAI and LLM GatewayAssemblyai