Why we no longer evaluate SWE-bench Verified

SWE-bench Verified is more and more contaminated and mismeasures frontier coding progress. Our evaluation exhibits flawed exams and coaching leakage. We suggest SWE-bench Pro.