One step towards building safe AI systems is to remove the need for humans to write goal functions, since using a simple proxy for a complex goal, or getting the complex goal a bit wrong, can lead to undesirable and even dangerous behavior. In collaboration with DeepMind’s safety team, we’ve developed an algorithm which can infer what humans want by being told which of two proposed behaviors is better.

Recommended

Making it easier for websites to express AI training preferencesOpenai Credit Saison achieves 954% ROI in a ChatGPT Enterprise pilotOpenai Community safety report and new protections for teensOpenai Operation "Doppelganger": Russian influence activity targeting UkraineOpenai Everyday work with ChatGPT WorkOpenai Romance scams: AI-enabled romance scam workflowsOpenai 10 best AI observability tools for monitoring and evaluating agents in 202610 best AI observability tools for monitoring and evaluating agents in 2026Mintlify An Introduction to Redis-ML. Part OneAn Introduction to Redis-ML. Part OneRedis Lessons Swift Designer Chris Lattner Has Learned about LeadershipLessons Swift Designer Chris Lattner Has Learned about LeadershipThenewstack Summer Data Engineering RoadmapSummer Data Engineering RoadmapMotherduck Revolutionizing Life Science and Healthcare with Generative AI - CerebrasRevolutionizing Life Science and Healthcare with Generative AI - CerebrasCerebras Simulating Human Behavior with Cerebras - CerebrasSimulating Human Behavior with Cerebras - CerebrasCerebras How To Create and Use Avatars in eLearningHow To Create and Use Avatars in eLearningHeygen From Hawking to Siri: The Evolution of Speech SynthesisFrom Hawking to Siri: The Evolution of Speech SynthesisDeepgram How Sky Italia Digitizes Learning Paths to Accelerate New Product Launches by 4xHow Sky Italia Digitizes Learning Paths to Accelerate New Product Launches by 4xSynthesia How EPOS achieved a 90% learning completition rate with AI video.How EPOS achieved a 90% learning completition rate with AI video.Synthesia How Mondelez Accelerates Supply Chain Training Across 150+ Global Manufacturing PlantsHow Mondelez Accelerates Supply Chain Training Across 150+ Global Manufacturing PlantsSynthesia Training: Hard Work Pays off for Data/AI ProsTraining: Hard Work Pays off for Data/AI ProsThenewstack Breakdown: The Kubernetes-Run AI Video Generation Pipeline for NIUS.TVBreakdown: The Kubernetes-Run AI Video Generation Pipeline for NIUS.TVThenewstack Cerebras Architecture Deep Dive: First Look Inside the HW/SW Co-Design for Deep Learning [Updated]Cerebras Architecture Deep Dive: First Look Inside the HW/SW Co-Design for Deep Learning [Updated]Cerebras