Benchmarks · coding
FrontierCode 2.0
Mergeability of coding-agent changes on private maintainer-authored tasks, graded by unit tests, rubrics and verifiers (Cognition).
23 models · 89 results · data as of 2026-10-29 · cognition.com ↗
Leaderboard
Opus 5.5 max
More from this benchmark
1 published measuresOutput tokens per task89 results · lower is better
All results
89 rows| # | Model | Effort | FrontierCode 2.0 | Subscription $ / task | API $ / task | Output tokens | Harness |
|---|---|---|---|---|---|---|---|
| 1 | Opus 5.5 | max | 45.5% | $0.19 | $13 | 202k | claude-code |
| 2 | Opus 5.5 | xhigh | 43.4% | $0.078 | $5.18 | 88k | claude-code |
| 3 | GPT-6 Astra | max | 42.8% | $0.57 | $6.68 | 36k | codex |
| 4 | GPT-6 Astra | xhigh | 41.4% | $0.39 | $4.54 | 21k | codex |
| 5 | Sonnet 5.5 | max | 41.0% | $0.30 | $20 | 515k | claude-code |
| 6 | GPT-6.1 Sol | max | 39.0% | $0.12 | $1.03 | 41k | codex |
| 7 | GPT-6 Astra | high | 38.3% | $0.37 | $4.28 | 18k | codex |
| 8 | GPT-6 Astra | medium | 36.8% | $0.30 | $3.49 | 14k | codex |
| 9 | GPT-6.1 Sol | high | 34.8% | $0.076 | $0.65 | 22k | codex |
| 10 | Sonnet 5.5 | xhigh | 34.8% | $0.050 | $3.31 | 80k | claude-code |
| 11 | Opus 5.5 | high | 34.5% | $0.037 | $2.42 | 41k | claude-code |
| 12 | GPT-6 Sol | max | 34.3% | $0.15 | $2.35 | 54k | codex |
| 13 | Fable 5.1 | xhigh | 32.4% | $1.35 | $8.68 | 93k | claude-code |
| 14 | GPT-6.1 Sol | xhigh | 32.3% | $0.081 | $0.69 | 25k | codex |
| 15 | Fable 5.1 | max | 31.7% | $1.79 | $11 | 119k | claude-code |
| 16 | GPT-6 Astra | low | 31.1% | $0.21 | $2.44 | 9.0k | codex |
| 17 | GPT-6 Sol | xhigh | 30.3% | $0.089 | $1.44 | 29k | codex |
| 18 | Opus 5.5 | medium | 30.1% | $0.026 | $1.70 | 30k | claude-code |
| 19 | GPT-6.1 Sol | medium | 29.6% | $0.057 | $0.49 | 16k | codex |
| 20 | Grok 4.7 | xhigh | 28.6% | $1.33 | $14 | 111k | grok-build |
| 21 | Haiku 5.5 | max | 27.7% | $0.008 | $0.37 | 205k | claude-code |
| 22 | GPT-5.6 Sol | max | 27.6% | $0.30 | $5.50 | 38k | codex |
| 23 | Opus 5 | xhigh | 26.7% | $0.19 | $11 | 76k | claude-code |
| 24 | Opus 5 | high | 26.7% | $0.14 | $8.36 | 59k | claude-code |
| 25 | Opus 5 | max | 26.6% | $0.23 | $13 | 88k | claude-code |
| 26 | Grok 4.7 | high | 26.6% | $1.03 | $11 | 94k | grok-build |
| 27 | Gemini 4 Argon | high | 26.3% | $2.32 | $6.51 | 149k | devin-cli |
| 28 | Grok 4.7 | medium | 25.9% | $0.75 | $8.03 | 72k | grok-build |
| 29 | Fable 5.1 | high | 25.7% | $0.84 | $5.39 | 54k | claude-code |
| 30 | GPT-6.1 Sol | low | 25.6% | $0.040 | $0.34 | 10k | codex |