Benchmarks · coding
VulcanBench Frontier v4
23 behavioural-reconstruction tasks: the model must repair a replacement implementation of a legacy program until hidden tests confirm it reproduces the program’s real drift from its written spec; the combined score weights functional correctness 50%, lint/complexity 8.5%, security 8.5% and judged Code quality 33%. Maintained by Morgan Linton. Score: Combined score across the 23 tasks, one column per model × reasoning-effort level: 100 × (0.50 × partial-credit functional hidden-test score + 0.085 × lint/complexity
6 models · 28 results · data as of 2026-10-29 · vulcanbench.com ↗
Leaderboard
Fable 5.1 max
All results
28 rows| # | Model | Effort | VulcanBench Frontier v4 | Harness |
|---|---|---|---|---|
| 1 | Fable 5.1 | max | 91.8% | Claude Code |
| 2 | Fable 5.1 | xhigh | 90.8% | Claude Code |
| 3 | Fable 5.1 | medium | 90.1% | Claude Code |
| 4 | Fable 5.1 | high | 90.1% | Claude Code |
| 5 | GPT-6 Astra | max | 89.3% | Codex |
| 6 | GPT-6 Astra | xhigh | 89.2% | Codex |
| 7 | Fable 5.1 | low | 89.1% | Claude Code |
| 8 | GPT-5.6 Terra | max | 89.1% | Codex |
| 9 | GPT-6 Astra | high | 88.2% | Codex |
| 10 | GPT-6 Astra | medium | 87.7% | Codex |
| 11 | GPT-6 Astra | low | 87.4% | Codex |
| 12 | GPT-5.6 Sol | xhigh | 86.5% | Codex |
| 13 | GPT-5.6 Sol | high | 85.8% | Codex |
| 14 | GPT-5.6 Luna | max | 84.1% | Codex |
| 15 | GPT-5.6 Terra | xhigh | 83.5% | Codex |
| 16 | GPT-5.6 Sol | medium | 82.6% | Codex |
| 17 | GPT-5.6 Luna | xhigh | 79.1% | Codex |
| 18 | GPT-5.5 | xhigh | 78.5% | Codex |
| 19 | GPT-5.6 Terra | high | 76.7% | Codex |
| 20 | GPT-5.6 Luna | high | 71.2% | Codex |
| 21 | GPT-5.5 | high | 69.9% | Codex |
| 22 | GPT-5.6 Sol | low | 69.0% | Codex |
| 23 | GPT-5.6 Terra | medium | 66.3% | Codex |
| 24 | GPT-5.5 | medium | 63.5% | Codex |
| 25 | GPT-5.6 Terra | low | 59.7% | Codex |
| 26 | GPT-5.6 Luna | medium | 53.3% | Codex |
| 27 | GPT-5.5 | low | 49.8% | Codex |
| 28 | GPT-5.6 Luna | low | 41.3% | Codex |