agentic
Vending-Bench 2
- #63default of 67$0.54
Leader: GPT-6 Astra · $15,515
Alibaba
Measured on 19 benchmarks.
General frontier
Not ranked in this mix — too little measured data for its benchmarks.
This model has no results on your mix’s benchmarks.
agentic
Leader: GPT-6 Astra · $15,515
coding
Leader: Fable 5.1 · 90.5%
coding
Leader: Opus 5 · 97.0%
coding
Leader: GPT-5.5 · 73.2%
coding
Leader: Sonnet 5.5 · 92.4%
economics
Leader: Opus 5 · 73.2%
economics
Leader: Opus 5 · 72.1%
knowledge
Leader: Grok 4.3 · 79.3%
knowledge
Leader: Gemini 3.1 Pro · 95.5%
knowledge
Leader: o1 · 96.5%
knowledge
Leader: Fable 5.1 · 92.4%
knowledge
Leader: Fable 5.1 · 90.6%
math
Leader: Gemini 3.1 Pro · 98.1%
reasoning
Leader: Fable 5 · 88.6%
reasoning
Leader: Opus 4.7 · 56.1%
reliability
Leader: GPT-5.4 Pro · 0.0%
reliability
Leader: GPT-5 Pro · 100.0%
speed
Leader: Qwen 2.5 7B · 0.2s
speed
Leader: Muse Spark 1.1 · 204.3