priorsBuilder

Anthropic · released 2025-08-05

Opus 4.1

Measured on 44 benchmarks.

General frontier

Not ranked in this mix — too little measured data for its benchmarks.

Your mix’s benchmarks

4 of 8 measured

reasoning

Humanity's Last Exam

587 results
  1. #270default of 58712.5%

Leader: Opus 5.5 · 61.4%

reasoning

BullshitBench v2

196 results
  1. #92none of 19643.0%
  2. #94high of 19642.0%

Leader: Opus 4.8 · 95.0%

math

FrontierMath Tier 4 (v2)

70 results
  1. #66high of 702.4%

Leader: GPT-6.1 Sol · 100.0%

reasoning

SimpleBench

97 results
  1. #39high of 9760.0%

Leader: Opus 5.5 · 88.4%

All 44 benchmarks

show 40 more

agentic

Butter-Bench

5 results
  1. #2high of 537.0%

Leader: Gemini 2.5 Pro · 40.0%

agentic

Terminal-Bench 2.0

40 results
  1. #24high of 4038.0%

Leader: GPT-5.5 · 84.7%

agentic

τ²-Bench Telecom

393 results
  1. #154default of 39371.4%

Leader: GLM 5.2 · 99.1%

coding

Arena WebDev

122 results
  1. #88high of 1221390

Leader: Opus 5.5 · 1813

coding

LiveCodeBench

282 results
  1. #84default of 28265.4%

Leader: Gemini 3 Pro · 91.7%

coding

LiveCodeBench (Vals)

127 results
  1. #94high of 12766.5%

Leader: Fable 5.1 · 90.5%

coding

Terminal-Bench Hard-AA

387 results
  1. #87default of 38734.3%

Leader: GPT-5.6 Sol · 65.9%

coding

WeirdML v2

127 results
  1. #71high of 12745.9%

Leader: GPT-6 Astra Pro · 93.6%

composite

AA Intelligence Index v4.3.2

610 results
  1. #191default of 61022.8
  2. #244none of 61018.6

Leader: Opus 5.5 · 57.6

composite

Arena Text

220 results
  1. #69high of 2201450

Leader: Gemini 4 · 1525

composite

Arena Text — Multi-Turn

220 results
  1. #51high of 2201471

Leader: Gemini 4 · 1553

creative

VoxelBench (image)

16 results
  1. #14high of 161105

Leader: GPT-6.1 Sol · 2214

creative

VoxelBench (text)

55 results
  1. #50high of 551227

Leader: GPT-6 Astra · 2732

economics

MortgageTax (Vals)

84 results
  1. #59high of 8461.1%

Leader: Opus 5 · 72.1%

economics

TaxEval (Vals)

125 results
  1. #46high of 12573.7%

Leader: Muse Spark 1.2 · 80.4%

instruction

IFBench

399 results
  1. #144default of 39955.4%

Leader: Grok 4.3 · 83.3%

knowledge

Arena Search

28 results
  1. #22high of 281148

Leader: GPT-5.6 Sol · 1257

knowledge

GPQA Diamond

539 results
  1. #186default of 53980.9%

Leader: GPT-6 Astra · 96.3%

knowledge

GPQA Diamond (Vals)

122 results
  1. #76high of 12276.3%

Leader: Gemini 3.1 Pro · 95.5%

knowledge

MedCode

94 results
  1. #33high of 9447.2%

Leader: Opus 5 · 63.6%

knowledge

MedQA (Vals)

80 results
  1. #22high of 8093.6%

Leader: o1 · 96.5%

knowledge

MedScribe

96 results
  1. #74high of 9673.9%

Leader: Opus 5.5 · 91.4%

knowledge

MMLU Pro (Vals)

122 results
  1. #23high of 12287.9%

Leader: Fable 5.1 · 92.4%

knowledge

MMLU-Pro

285 results
  1. #7default of 28588.0%

Leader: Gemini 3 Pro · 89.8%

knowledge

MMMU Pro (Vals)

81 results
  1. #50high of 8177.5%

Leader: Fable 5.1 · 90.6%

knowledge

MMMU-Pro

265 results
  1. #160default of 26567.9%

Leader: Opus 5.5 · 87.7%

long-context

AA-LCR v1.1

523 results
  1. #148default of 52376.0%

Leader: Kimi K3 · 88.7%

math

AIME (Vals)

82 results
  1. #48high of 8278.2%

Leader: Gemini 3.1 Pro · 98.1%

math

AIME 2025

228 results
  1. #57default of 22880.3%

Leader: GPT-5.2 · 99.0%

math

FrontierMath Tiers 1–3 (v2)

115 results
  1. #100high of 11512.6%

Leader: GPT-6.1 Sol · 93.7%

math

MATH 500 (Vals)

48 results
  1. #4high of 4895.4%

Leader: Gemini 3 Pro · 96.4%

math

MGSM (Vals)

62 results
  1. #2high of 6294.4%

Leader: Opus 4.5 · 95.2%

reasoning

CritPt

529 results
  1. #312default of 5290.0%

Leader: Muse Wonder Full (Max) · 32.9%

reasoning

LegalBench

135 results
  1. #53high of 13583.5%

Leader: Fable 5 · 88.6%

reasoning

SAGE

80 results
  1. #71high of 8031.4%

Leader: Opus 4.7 · 56.1%

reasoning

SimpleQA Verified

47 results
  1. #27high of 4731.0%

Leader: Gemini 3.1 Pro · 77.5%

reliability

Tool-call error rate

171 results
  1. #42high of 1710.4%

Leader: GPT-5.4 Pro · 0.0%

reliability

Uptime (7d)

181 results
  1. #22high of 181100.0%

Leader: GPT-5 Pro · 100.0%

speed

Provider latency

177 results
  1. #158high of 1773.8s

Leader: Qwen 2.5 7B · 0.2s

speed

Provider throughput

176 results
  1. #175high of 17612.0

Leader: Muse Spark 1.1 · 204.3