Why SWE-bench Verified no longer measures frontier coding capabilities
Why SWE-bench Verified no longer measures frontier coding capabilities
Why it matters
At least 59.4% of the audited problems had flawed tests; the vendor acknowledges that the benchmark harness's signal is contaminated
Source — Primary sources first; secondary reports are labelled “Press”
Officialopenai.comhttps://openai.com/index/why-we-no-longer-evaluate-swe-bench-verified/Added in Week 35, 2026 · See that week