Benchmarks · coding
SWE-bench Verified (Epoch AI)
The human-verified SWE-bench subset: resolve real GitHub issues in a repository. Run by Epoch AI with its own scaffold; resolve rate. Data: Epoch AI, CC BY.
32 models · 33 results · data as of 2026-10-29 · epoch.ai ↗
Leaderboard
Opus 4.7 max
All results
33 rows| # | Model | Effort | Score | Harness |
|---|---|---|---|---|
| 1 | Opus 4.7 | max | 83.5% | Epoch AI |
| 2 | GPT-5.5 | xhigh | 80.6% | Epoch AI |
| 3 | Gemini 3.5 Flash | high | 79.3% | Epoch AI |
| 4 | Opus 4.6 | max | 78.7% | Epoch AI |
| 5 | GLM 5.2 | max | 78.7% | Epoch AI |
| 6 | DeepSeek V4 Pro | max | 77.6% | Epoch AI |
| 7 | Qwen 3.7 Max | max | 77.3% | Epoch AI |
| 8 | GPT-5.4 | high | 76.9% | Epoch AI |
| 9 | Opus 4.5 | high | 76.7% | Epoch AI |
| 10 | Kimi K2.6 | max | 76.7% | Epoch AI |
| 11 | Qwen 3.6 Max | max | 76.7% | Epoch AI |
| 12 | Gemini 3.1 Pro | high | 75.6% | Epoch AI |
| 13 | Gemini 3 Flash | high | 75.4% | Epoch AI |
| 14 | Sonnet 4.6 | max | 75.2% | Epoch AI |
| 15 | GPT-5.3 Codex | high | 74.8% | Epoch AI |
| 16 | GLM 5.1 | max | 74.2% | Epoch AI |
| 17 | GPT-5.2 | high | 73.8% | Epoch AI |
| 18 | Kimi K2.5 | max | 73.8% | Epoch AI |
| 19 | GPT-5 | high | 73.6% | Epoch AI |
| 20 | Opus 4.1 | high | 73.3% | Epoch AI |
| 21 | Gemini 3 Pro | high | 72.9% | Epoch AI |
| 22 | GLM 5 | high | 72.1% | Epoch AI |
| 23 | GPT-5 | medium | 71.5% | Epoch AI |
| 24 | Sonnet 4.5 | high | 71.3% | Epoch AI |
| 25 | Opus 4 | medium | 70.7% | Epoch AI |
| 26 | GPT-5.1 | high | 68.0% | Epoch AI |
| 27 | GPT-5 Mini | medium | 64.7% | Epoch AI |
| 28 | o3 | medium | 62.3% | Epoch AI |
| 29 | Sonnet 3.7 | medium | 61.0% | Epoch AI |
| 30 | Qwen 3.6 Plus | max | 57.9% | Epoch AI |