SWE-bench Verified is increasingly contaminated and mismeasures frontier coding progress. Our analysis shows flawed tests and training leakage. We recommend SWE-bench Pro.

Recommended

Operation "Doppelganger": Russian influence activity targeting UkraineOpenai Everyday work with ChatGPT WorkOpenai Romance scams: AI-enabled romance scam workflowsOpenai Will Hurd joins OpenAI’s board of directorsOpenai Statement from the OpenAI Board of Directors on the Nonprofit Commission ReportOpenai Simplifying, stabilizing, and scaling continuous-time consistency modelsOpenai Docker Scout health scores: Security grading for container images in your Docker Hub registryDocker Scout health scores: Security grading for container images in your Docker Hub registryDocker Docker Verified Publisher: Trusted Sources, Trusted ContentDocker Verified Publisher: Trusted Sources, Trusted ContentDocker How to Protect Your Projects from the Risks of Deprecated npm PackagesHow to Protect Your Projects from the Risks of Deprecated npm PackagesSocket How to Evaluate an SCA with Reachability: Benchmarking Hard-to-Analyze Language FeaturesHow to Evaluate an SCA with Reachability: Benchmarking Hard-to-Analyze Language FeaturesSocket blink element ( tag) - Glossaryblink element ( tag) - GlossaryDeveloper Mozilla Making the Most of Your Docker Hardened Images Enterprise Trial - Part 1Making the Most of Your Docker Hardened Images Enterprise Trial - Part 1Docker Best API Docs & SDK Generation Tools in 2026Best API Docs & SDK Generation Tools in 2026Mintlify Introducing Rotated Secrets in Pulumi ESCIntroducing Rotated Secrets in Pulumi ESCPulumi Garbage collection - GlossaryGarbage collection - GlossaryDeveloper Mozilla Docker Hardened Images enhanced vulnerability scanning with Docker and Aikido | DockerDocker Hardened Images enhanced vulnerability scanning with Docker and Aikido | DockerDocker Patient Education Technology: Types, Examples & EvaluationPatient Education Technology: Types, Examples & EvaluationHeygen For Better or Worse, Richard Stallman Returns to the Free Software FoundationFor Better or Worse, Richard Stallman Returns to the Free Software FoundationThenewstack Neo: Zero-downtime migration from CDK, Terraform & Azure ARMNeo: Zero-downtime migration from CDK, Terraform & Azure ARMPulumi We're no longer sunsetting the Free Team planWe're no longer sunsetting the Free Team planDocker