- #6max of 4453.8%
Leader: Gemini 3.7 Flash · 60.0%
- #20max of 2241578
- #28xhigh of 2241533
- #46high of 2241442
- #58medium of 2241372
- #100low of 2241112
Leader: Sonnet 5.5 · 1823
agentic
AutomationBench (Zapier)
115 results- #65medium of 11512.0%
Leader: Gemini 4 · 51.3%
agentic
AutomationBench-AA
219 results- #101xhigh of 21936.0%
- #104max of 21935.4%
- #108high of 21933.7%
- #113medium of 21928.6%
- #126low of 21922.9%
Leader: Gemini 4 · 77.5%
- #12max of 2770.4%
Leader: Sonnet 5.5 · 81.1%
agentic
Harvey's Legal Agent Benchmark
79 results- #57max of 791.3%
Leader: Muse Spark 1.2 · 25.4%
agentic
Legal Research Bench
78 results- #22max of 7843.3%
Leader: Muse Spark 1.3 · 55.3%
- #20max of 6931.9%
Leader: Fable 5.1 · 49.2%
agentic
Terminal-Bench 4.0 (Vals)
47 results- #14max of 4735.4%
Leader: Opus 5.5 · 65.2%
agentic
Terminal-Bench Science (Vals)
40 results- #16max of 4010.0%
Leader: GPT-6 Astra · 62.9%
- #45max of 67$3,602
Leader: GPT-6 Astra · $15,515
- #29high of 1221587
Leader: Opus 5.5 · 1813
- #21max of 7744.6%
Leader: Sonnet 5.5 · 69.8%
coding
FrontierCode 1.1 Extended
130 results- #43max of 13058.4%
- #45xhigh of 13058.1%
- #58high of 13055.9%
- #64medium of 13055.0%
- #93low of 13048.2%
Leader: Opus 5.5 · 65.3%
coding
FrontierCode 1.1 Main
130 results- #39max of 13046.4%
- #43xhigh of 13045.8%
- #62high of 13041.9%
- #63medium of 13041.6%
- #93low of 13034.8%
Leader: Opus 5.5 · 54.6%
- #8max of 2143.8%
Leader: GPT-6 Astra · 65.5%
- #29max of 4447.3%
Leader: Gemini 4 · 100.0%
- #52max of 22655.0%
- #87xhigh of 22651.7%
- #115low of 22649.2%
- #117medium of 22649.0%
- #118high of 22648.7%
Leader: Opus 5.5 · 66.9%
coding
Terminal-Bench Science-AA
46 results- #15max of 4620.0%
- #16xhigh of 4618.1%
- #25high of 4610.0%
- #30medium of 467.1%
- #39low of 461.9%
Leader: GPT-6 Astra · 63.3%
coding
Terminal-Bench v4-AA
216 results- #40max of 21632.8%
- #46xhigh of 21629.3%
- #57high of 21621.7%
- #67medium of 21615.2%
- #79low of 21612.6%
Leader: Sonnet 5.5 · 63.6%
coding
Vibe Code Bench 1-100
22 results- #7max of 2220.4%
Leader: Opus 5.5 · 30.4%
coding
Vibe Code Bench v1.1
105 results- #3max of 10590.4%
Leader: Sonnet 5.5 · 92.4%
composite
AA Intelligence Index v4.3.2
610 results- #45max of 61043.4
- #55xhigh of 61041.2
- #78high of 61037.8
- #88medium of 61034.5
- #124low of 61029.5
Leader: Opus 5.5 · 57.6
- #18max of 4754.3%
Leader: Gemini 4 · 68.9%
cost
AA Intelligence Index Cost per Task
177 results- #16low of 177$0.02
- #22medium of 177$0.05
- #33high of 177$0.08
- #44xhigh of 177$0.12
- #59max of 177$0.21
Leader: GPT-6 Luna · $0.00
cost
Cost to Run AA Intelligence Index
177 results- #12low of 177$34.31
- #19medium of 177$56.36
- #23high of 177$94.07
- #38xhigh of 177$158
- #54max of 177$330
Leader: GPT-6 Luna · $10.63
- #22high of 341434
Leader: Opus 5.5 · 2079
creative
VoxelBench (text)
55 results- #21max of 551754
Leader: GPT-6 Astra · 2732
economics
Excel Modeling Benchmark
74 results- #36max of 7459.0%
Leader: Fable 5.1 · 76.7%
economics
Finance Agent v2
78 results- #26max of 7854.1%
Leader: Gemini 4 · 65.4%
- #58max of 21020.8%
- #73xhigh of 21018.2%
- #82high of 21017.2%
- #92medium of 21015.2%
- #116low of 21011.2%
Leader: Muse Wonder Full (Max) · 32.6%
- #24max of 2881620
- #47xhigh of 2881511
- #70high of 2881418
- #101medium of 2881274
- #130low of 2881122
Leader: Opus 5.5 · 1866
knowledge
AA-Omniscience Accuracy
526 results- #147max of 52636.4%
- #150xhigh of 52634.9%
- #154high of 52634.8%
- #157medium of 52634.0%
- #161low of 52633.3%
Leader: Fable 5.1 · 67.2%
knowledge
AA-Omniscience Non-hallucination
526 results- #76max of 52659.6%
- #90xhigh of 52655.6%
- #91high of 52655.5%
- #93medium of 52655.2%
- #95low of 52655.1%
Leader: MiniCPM5-1B (Non-reasoning) · 99.1%
knowledge
Harvey LAB-AA v1.1
27 results- #14xhigh of 272.8%
- #16low of 271.7%
- #17high of 271.1%
- #19max of 270.6%
- #20medium of 270.6%
Leader: Muse Wonder Full (Max) · 13.1%
- #15max of 9451.5%
Leader: Opus 5 · 63.6%
- #6max of 9689.5%
Leader: Opus 5.5 · 91.4%
knowledge
Public Benefits Bench v1.1
50 results- #25max of 5063.2%
Leader: Opus 5 · 76.9%
- #36max of 52382.7%
- #109xhigh of 52378.3%
- #127high of 52377.3%
- #128medium of 52377.3%
- #189low of 52372.0%
Leader: Kimi K3 · 88.7%
- #5max of 9463.3%
Leader: Sonnet 5.5 · 75.0%
math
FrontierMath Tiers 1–3 (v2)
115 results- #18max of 11575.1%
Leader: GPT-6.1 Sol · 93.7%
- #11max of 5289.0%
Leader: Sonnet 5.5 · 100.0%
- #25max of 850.0%
Leader: Opus 5.5 · 29.1%
reasoning
Blueprint-Bench 2
28 results- #13max of 2833.0%
Leader: Gemini 4 · 54.4%
- #53xhigh of 52922.6%
- #64max of 52918.9%
- #65high of 52918.6%
- #99medium of 52912.9%
- #121low of 5299.1%
Leader: Muse Wonder Full (Max) · 32.9%
reasoning
Furniture Assembly
31 results- #10max of 3147.5%
Leader: Opus 5.5 · 83.3%
reasoning
MysteryMechanism
27 results- #10max of 2735.1%
Leader: GPT-6 Astra · 53.2%
reasoning
Roboflow Visual Reasoning
102 results- #23high of 10274.8%
- #42low of 10268.9%
Leader: GPT-6 Astra · 91.2%
- #38max of 8045.8%
Leader: Opus 4.7 · 56.1%
reasoning
SimpleQA Verified
47 results- #34max of 4723.9%
Leader: Gemini 3.1 Pro · 77.5%
reliability
Tool-call error rate
171 results- #108max of 1712.2%
Leader: GPT-5.4 Pro · 0.0%
- #23max of 181100.0%
Leader: GPT-5 Pro · 100.0%
- #6max of 4575.5%
Leader: Wonder · 80.4%
- #14max of 325.7%
Leader: GPT-6 Astra · 56.9%
speed
Latency (Time to First Token)
351 results- #246low of 3518.9s
- #259medium of 35113s
- #292high of 35125s
- #325xhigh of 35179s
- #347max of 351315s
Leader: Gemini 2.5 Flash-Lite · 0.3s
speed
Output Speed (tokens/s)
351 results- #23max of 351236.4
- #54xhigh of 351188.1
- #61medium of 351178.7
- #65high of 351176.3
- #70low of 351171.0
Leader: Celeris-1 · 1522.5
- #105max of 1771.5s
Leader: Qwen 2.5 7B · 0.2s
- #4max of 176145.8
Leader: Muse Spark 1.1 · 204.3