priorsBuilder

Alibaba · released 2025-07-23

Qwen 3 Coder

Measured on 38 benchmarks.

General frontier

Not ranked in this mix — too little measured data for its benchmarks.

Your mix’s benchmarks

3 of 8 measured

reasoning

Humanity's Last Exam

587 results
  1. #312none of 58710.1%

Leader: Opus 5.5 · 61.4%

knowledge

AA-Omniscience

526 results
  1. #244none of 526-22.2

Leader: Opus 5.5 · 46.4

reasoning

BullshitBench v2

196 results
  1. #143medium of 19620.0%

Leader: Opus 4.8 · 95.0%

All 38 benchmarks

show 35 more

agentic

AA-Briefcase v1.1

224 results
  1. #183none of 224404

Leader: Sonnet 5.5 · 1823

agentic

AutomationBench-AA

219 results
  1. #188none of 2191.1%

Leader: Gemini 4 · 77.5%

agentic

Terminal-Bench 2.0

40 results
  1. #33medium of 4027.2%

Leader: GPT-5.5 · 84.7%

agentic

τ²-Bench Telecom

393 results
  1. #128none of 39379.5%

Leader: GLM 5.2 · 99.1%

agentic

τ³-Banking

206 results
  1. #183none of 2065.4%

Leader: Qwen 3.8 Max · 51.3%

coding

Arena WebDev

122 results
  1. #109medium of 1221275

Leader: Opus 5.5 · 1813

coding

LiveCodeBench

282 results
  1. #107none of 28258.5%

Leader: Gemini 3 Pro · 91.7%

coding

SciCode

226 results
  1. #193none of 22636.2%

Leader: Opus 5.5 · 66.9%

coding

Terminal-Bench Hard-AA

387 results
  1. #170none of 38718.9%

Leader: GPT-5.6 Sol · 65.9%

coding

Terminal-Bench v2.1-AA

238 results
  1. #146none of 23838.2%

Leader: Fable 5.1 · 91.4%

coding

Terminal-Bench v4-AA

216 results
  1. #194none of 2160.0%

Leader: Sonnet 5.5 · 63.6%

coding

WeirdML v2

127 results
  1. #84medium of 12741.2%

Leader: GPT-6 Astra Pro · 93.6%

composite

AA Intelligence Index v4.3.2

610 results
  1. #332none of 61011.9

Leader: Opus 5.5 · 57.6

composite

Arena Text

220 results
  1. #132medium of 2201388

Leader: Gemini 4 · 1525

composite

Arena Text — Multi-Turn

220 results
  1. #126medium of 2201397

Leader: Gemini 4 · 1553

cost

AA Intelligence Index Cost per Task

177 results
  1. #102none of 177$0.78

Leader: GPT-6 Luna · $0.00

cost

Cost to Run AA Intelligence Index

177 results
  1. #84none of 177$663

Leader: GPT-6 Luna · $10.63

economics

GDP.pdf

210 results
  1. #180none of 2102.6%

Leader: Muse Wonder Full (Max) · 32.6%

economics

GDPval-AA v2.1

288 results
  1. #213none of 288513

Leader: Opus 5.5 · 1866

instruction

IFBench

399 results
  1. #254none of 39940.5%

Leader: Grok 4.3 · 83.3%

knowledge

AA-Omniscience Accuracy

526 results
  1. #370none of 52616.4%

Leader: Fable 5.1 · 67.2%

knowledge

AA-Omniscience Non-hallucination

526 results
  1. #94none of 52655.1%

Leader: MiniCPM5-1B (Non-reasoning) · 99.1%

knowledge

Global-MMLU-Lite

118 results
  1. #77none of 11879.4%

Leader: Gemini 3.1 Pro · 93.2%

knowledge

GPQA Diamond

539 results
  1. #260none of 53973.7%

Leader: GPT-6 Astra · 96.3%

knowledge

MMLU-Pro

285 results
  1. #111none of 28578.8%

Leader: Gemini 3 Pro · 89.8%

long-context

AA-LCR v1.1

523 results
  1. #314none of 52347.0%

Leader: Kimi K3 · 88.7%

math

AIME 2025

228 results
  1. #134none of 22839.3%

Leader: GPT-5.2 · 99.0%

math

MATH-500

162 results
  1. #40none of 16294.2%

Leader: GPT-5 · 99.4%

reasoning

CritPt

529 results
  1. #357none of 5290.0%

Leader: Muse Wonder Full (Max) · 32.9%

reliability

Tool-call error rate

172 results
  1. #102medium of 1721.9%

Leader: Gemini 4 · 0.0%

reliability

Uptime (7d)

182 results
  1. #166medium of 18296.8%

Leader: GPT-5 Pro · 100.0%

speed

Latency (Time to First Token)

351 results
  1. #73none of 3511.0s

Leader: Gemini 2.5 Flash Lite · 0.3s

speed

Output Speed (tokens/s)

351 results
  1. #84none of 351158.9

Leader: Celeris-1 · 1564.1

speed

Provider latency

178 results
  1. #50medium of 1780.9s

Leader: Qwen 2.5 7B · 0.2s

speed

Provider throughput

176 results
  1. #100medium of 17656.0

Leader: Muse Spark 1.1 · 204.5