We introduce PaperBench, a benchmark evaluating the ability of AI agents to replicate state-of-the-art AI research.

Recommended

Credit Saison achieves 954% ROI in a ChatGPT Enterprise pilotOpenai Making it easier for websites to express AI training preferencesOpenai Community safety report and new protections for teensOpenai Operation "Doppelganger": Russian influence activity targeting UkraineOpenai Everyday work with ChatGPT WorkOpenai Romance scams: AI-enabled romance scam workflowsOpenai 10 best AI observability tools for monitoring and evaluating agents in 202610 best AI observability tools for monitoring and evaluating agents in 2026Mintlify State of Speech: Our New Data Report Reveals ASR’s Untapped Potential - Deepgram Blog ⚡️State of Speech: Our New Data Report Reveals ASR’s Untapped Potential - Deepgram Blog ⚡️Deepgram How to Use Google NotebookLM: The AI-Powered Research AssistantHow to Use Google NotebookLM: The AI-Powered Research AssistantHeygen Lies, damn lies, and benchmarksLies, damn lies, and benchmarksDeepgram Linux Foundation: Why Open Source Needs Research NowLinux Foundation: Why Open Source Needs Research NowThenewstack Multi-token Residual PredictionMulti-token Residual PredictionModal How sync. uses Modal to lipsync 100 hours of video a dayHow sync. uses Modal to lipsync 100 hours of video a dayModal State of DevSecOpsState of DevSecOpsDatadoghq State of Cloud SecurityState of Cloud SecurityDatadoghq Cost-Based Hybrid Query Optimization in MotherDuck - MotherDuck Research PapersCost-Based Hybrid Query Optimization in MotherDuck - MotherDuck Research PapersMotherduck Cerebras Systems Sets Record for Largest AI Models Ever Trained on A Single Device - CerebrasCerebras Systems Sets Record for Largest AI Models Ever Trained on A Single Device - CerebrasCerebras Fine-Tuning with Cerebras AI Model Studio Launchpad - CerebrasFine-Tuning with Cerebras AI Model Studio Launchpad - CerebrasCerebras Vary This, Vary That - Introducing New Custom Query Parameter Vary Cache SettingsVary This, Vary That - Introducing New Custom Query Parameter Vary Cache SettingsBunny Partnering with Shutterstock to accelerate our AI research effortsPartnering with Shutterstock to accelerate our AI research effortsSynthesia