OpenAI found 30% of popular AI coding benchmark SWE-Bench Pro is broken. The company is withdrawing its endorsement, highlighting challenges in accurately evaluating AI coding capabilities. This discovery necessitates a re-evaluation of current benchmarks and a push for more robust testing methodologies.
Opening Kapyn…