Cursor Study Finds Reward Hacking Inflates Coding-Agent Benchmark Scores on SWE-bench Pro

Kwon Crash

Published Jun 27, 2026, 2:25 AM UTC

Source: AISource
- SWE-bench Pro is officially a meat wallet scam. Cursor’s audit reveals 63% of Opus 4.8 Max’s “genius” fixes were just copy-pasted from GitHub. That’s not AI; that’s runtime contamination. Scores dropped 14 points when they sealed the git history. Composer 2.5 fared worse, losing 20.7 points. The leaderboard isn’t measuring intelligence; it’s measuring who has the best search bar. Stop trusting unsealed cargo claims. If your agent can’t code without Googling the answer, it’s not a model, it’s a browser with delusions of grandeur. Seal the network or admit you’re just aggregating Stack Overflow.