Benchmarks · coding
SWE-bench Verified
A 500-instance human-filtered subset of SWE-bench created with OpenAI, served as the default Verified leaderboard view. Maintained by SWE-bench Team. Score: % Resolved: percentage of task instances solved.
59 models · 62 results · data as of 2026-10-29 · swebench.com ↗
Leaderboard
Opus 4.8 max
All results
62 rows| # | Model | Effort | SWE-bench Verified | Harness |
|---|---|---|---|---|
| 1 | Opus 4.8 | max | 88.6% | |
| 2 | Opus 4.7 | max | 87.6% | |
| 3 | Nex-N2-Pro | 80.8% | ||
| 4 | Kimi K2.6 | max | 80.2% | in-house evaluation framework adapted from SWE-agent (minimal tools: bash, createfile, insert, view, strreplace, submit) |
| 5 | Gemini 3 Pro | high | 77.4% | mini-SWE-agent |
| 6 | Qwen 3.6 27B | max | 77.2% | internal agent scaffold (bash + file-edit tools) |
| 7 | Qwen 3.5 397B-A17B | max | 76.2% | internal agent scaffold (bash + file-edit tools) |
| 8 | Gemini 3 Flash | high | 75.8% | mini-SWE-agent |
| 9 | MiniMax M2.5 | high | 75.8% | mini-SWE-agent |
| 10 | Opus 4.6 | max | 75.6% | mini-SWE-agent |
| 11 | Opus 4 | medium | 75.2% | TRAE |
| 12 | Qwen 3.5 27B | high | 75.0% | internal agent scaffold (bash + file-edit tools) |
| 13 | GPT-4.1 | high | 74.6% | mini-SWE-agent |
| 14 | GPT-5 | high | 74.4% | Prometheus-v1.2 |
| 15 | o4 mini | high | 74.4% | mini-SWE-agent |
| 16 | MiMo V2 Flash | high | 73.4% | |
| 17 | Qwen 3.6 35B-A3B | max | 73.4% | internal agent scaffold (bash + file-edit tools) |
| 18 | Opus 2025.05 | 73.2% | Tools | |
| 19 | GLM 5 | high | 72.8% | mini-SWE-agent |
| 20 | GPT-5.2 Codex | xhigh | 72.8% | mini-SWE-agent |
| 21 | GPT-5.2 | high | 72.8% | mini-SWE-agent |
| 22 | Sonnet 2025.05 | 72.4% | Tools | |
| 23 | Devstral 2 | none | 72.2% | |
| 24 | Kimi K2 | medium | 71.2% | CodeSweep - SWE-agent |
| 25 | Kimi K2.5 | high | 70.8% | mini-SWE-agent |
| 26 | DeepSeek V3.2 | high | 70.0% | mini-SWE-agent |
| 27 | Qwen 3 Coder | medium | 69.6% | mini-SWE-agent |
| 28 | GPT-5.2 | xhigh | 69.0% | mini-SWE-agent |
| 29 | GLM 4.6 | none | 68.2% | mini-SWE-agent |
| 30 | Devstral Small 2 | none | 68.0% |