Benchmarks · agentic
Vending-Bench 2
Year-long simulated vending-machine business; agents handle suppliers, inventory, pricing, and refunds. Score is the final bank balance.
66 models · 71 results · data as of 2026-10-29 · andonlabs.com ↗
Leaderboard
Gemini 4 Carbon max
Money balance ($) by day
As published by andonlabs.com, one line per run · follows the leaderboard’s model and effort settings
Top 10 of 66 runs by score ·
More from this benchmark
1 published measuresOutput tokens per task68 results · lower is better
All results
71 rows| # | Model | Effort | Vending-Bench 2 | Subscription $ / task | API $ / task | Output tokens |
|---|---|---|---|---|---|---|
| 1 | Gemini 4 Carbon | max | $16,484 | $370 | $370 | 521k |
| 2 | GPT-6 Astra | max | $15,515 | $69 | $810 | 321k |
| 3 | GPT-6 Sol | max | $14,428 | $6.85 | $111 | 420k |
| 4 | Gemini 4 Argon | max | $13,718 | $249 | $249 | 193k |
| 5 | Muse Wonder Full | max | $12,292 | |||
| 6 | Opus 5 | max | $11,182 | $9.62 | $555 | 440k |
| 7 | Sonnet 5.5 | max | $11,165 | $3.31 | $219 | 2.1M |
| 8 | Opus 4.7 | max | $10,937 | $559 | $559 | 440k |
| 9 | Grok 4.7 | max | $10,537 | $23 | $248 | 252k |
| 10 | GPT-5.6 Sol | max | $9,619 | $19 | $340 | 284k |
| 11 | Muse Wonder (Max) | max | $9,432 | $219 | $329 | 269k |
| 12 | Opus 5.5 | max | $9,235 | $7.20 | $476 | 829k |
| 13 | GPT-6.1 Terra | max | $9,107 | $63 | $63 | 254k |
| 14 | Grok 4.6 | max | $9,047 | $23 | $223 | 1.2M |
| 15 | GLM 5.2 | max | $8,314 | $16 | $184 | 234k |
| 16 | GLM 5.3 | max | $8,164 | $13 | $128 | 305k |
| 17 | Opus 4.6 | max | $8,018 | $682 | $682 | 272k |
| 18 | GPT-5.5 | xhigh | $7,524 | $14 | $256 | 586k |
| 19 | GPT-5.6 Terra | max | $7,343 | $8.09 | $147 | 400k |
| 20 | Sonnet 4.6 | max | $7,204 | $265 | $265 | 1.7M |
| 21 | Muse Spark 1.1 | max | $6,520 | $54 | $54 | 185k |
| 22 | Sonnet 5 | max | $6,378 | $4.29 | $248 | 327k |
| 23 | Kimi K2.6 | max | $6,205 | $128 | $128 | 685k |
| 24 | GPT-5.4 | xhigh | $6,144 | $114 | $114 | 587k |
| 25 | GPT-5.3 Codex | xhigh | $5,940 | $68 | $68 | 370k |
| 26 | Opus 4.8 | high | $5,787 | $7.89 | $455 | 414k |
| 27 | Fable 5 | high | $5,680 | $154 | $1369 | 312k |
| 28 | GLM 5.1 | max | $5,634 | $170 | $170 | 268k |
| 29 | Gemini 3 Pro | high | $5,478 | $147 | $147 | 475k |
| 30 | Fable 5.1 | max | $5,422 | $234 | $1504 | 318k |