Benchmarks · Vision · Reasoning & puzzles
Penalty Bench
Refereeing football penalties: 101 incidents from the 2026 season, judged penalty or no penalty against expert verdicts. Accuracy; the referee scored 47.5% on the pitch and 63.4% with VAR. A small, not-so-serious bench by Wenhao Chai.
9 models · 9 results · data as of 2026-11-13 · wenhaochai.com ↗
Leaderboard
GPT-6.1 Terra
All results
9 rows| # | Model | Effort | Penalty Bench | Harness |
|---|---|---|---|---|
| 1 | GPT-6.1 Terra | 64.4% ±8.9 | Codex | |
| 2 | Gemini 4 Carbon | 63.4% ±9.4 | Antigravity | |
| 3 | GPT-6.1 Sol | 57.4% ±9.9 | Codex | |
| 4 | Opus 5.5 | 56.4% ±9.4 | Claude Code | |
| 5 | Gemini 4 Argon | 53.5% ±9.9 | Antigravity | |
| 6 | GPT-6 Luna | 52.5% ±9.9 | Codex | |
| 7 | Sonnet 5.5 | 46.5% ±9.9 | Claude Code | |
| 8 | Gemini 3.8 Flash | 44.6% ±9.9 | Antigravity | |
| 9 | Haiku 5.5 | 38.6% ±9.4 | Claude Code |