priorsBuilder

Anthropic · released 2025-02-24

Sonnet 3.7

Measured on 34 benchmarks.

General frontier

Not ranked in this mix — too little measured data for its benchmarks.

Your mix’s benchmarks

4 of 8 measured

reasoning

Humanity's Last Exam

587 results
  1. #320default of 5879.7%
  2. #517none of 5874.2%

Leader: Opus 5.5 · 61.4%

knowledge

AA-Omniscience

526 results
  1. #136default of 526-0.7
  2. #184none of 526-9.7

Leader: Opus 5.5 · 46.4

reasoning

BullshitBench v2

196 results
  1. #76medium of 19649.0%

Leader: Opus 4.8 · 95.0%

reasoning

SimpleBench

97 results
  1. #58medium of 9746.4%

Leader: Opus 5.5 · 88.4%

All 34 benchmarks

show 30 more

agentic

OSWorld-Verified

13 results
  1. #11medium of 1335.8%

Leader: Fable 5 · 86.0%

agentic

τ²-Bench Telecom

393 results
  1. #189default of 39354.7%
  2. #200none of 39350.0%

Leader: GLM 5.2 · 99.1%

coding

LiveCodeBench

282 results
  1. #131default of 28247.3%
  2. #156none of 28239.4%

Leader: Gemini 3 Pro · 91.7%

coding

LiveCodeBench (Vals)

127 results
  1. #99medium of 12760.4%

Leader: Fable 5.1 · 90.5%

coding

Terminal-Bench Hard-AA

387 results
  1. #160default of 38721.2%
  2. #161none of 38721.2%

Leader: GPT-5.6 Sol · 65.9%

composite

AA Intelligence Index v4.3.2

610 results
  1. #254default of 61017.7
  2. #281none of 61015.3

Leader: Opus 5.5 · 57.6

composite

Arena Text

220 results
  1. #131medium of 2201388

Leader: Gemini 4 · 1525

composite

Arena Text — Multi-Turn

220 results
  1. #124medium of 2201400

Leader: Gemini 4 · 1553

economics

CorpFin (Vals)

117 results
  1. #68medium of 11760.4%

Leader: Opus 5 · 73.2%

economics

MortgageTax (Vals)

84 results
  1. #13medium of 8468.7%

Leader: Opus 5 · 72.1%

economics

TaxEval (Vals)

125 results
  1. #41medium of 12574.0%

Leader: Muse Spark 1.2 · 80.4%

instruction

IFBench

399 results
  1. #181default of 39948.3%
  2. #217none of 39944.0%

Leader: Grok 4.3 · 83.3%

knowledge

AA-Omniscience Accuracy

526 results
  1. #196none of 52628.2%
  2. #197default of 52628.0%

Leader: Fable 5.1 · 67.2%

knowledge

AA-Omniscience Non-hallucination

526 results
  1. #74default of 52660.0%
  2. #130none of 52647.2%

Leader: MiniCPM5-1B (Non-reasoning) · 99.1%

knowledge

GPQA Diamond

539 results
  1. #219default of 53977.2%
  2. #331none of 53965.6%

Leader: GPT-6 Astra · 96.3%

knowledge

GPQA Diamond (Vals)

122 results
  1. #79medium of 12275.3%

Leader: Gemini 3.1 Pro · 95.5%

knowledge

MedQA (Vals)

80 results
  1. #42medium of 8090.2%

Leader: o1 · 96.5%

knowledge

MMLU Pro (Vals)

122 results
  1. #73medium of 12282.7%

Leader: Fable 5.1 · 92.4%

knowledge

MMLU-Pro

285 results
  1. #42default of 28583.7%
  2. #92none of 28580.3%

Leader: Gemini 3 Pro · 89.8%

knowledge

MMMU Pro (Vals)

81 results
  1. #54medium of 8175.1%

Leader: Fable 5.1 · 90.6%

knowledge

MMMU-Pro

265 results
  1. #200none of 26560.1%

Leader: Opus 5.5 · 87.7%

long-context

AA-LCR v1.1

523 results
  1. #303none of 52351.7%

Leader: Kimi K3 · 88.7%

math

AIME (Vals)

82 results
  1. #60medium of 8244.6%

Leader: Gemini 3.1 Pro · 98.1%

math

AIME 2025

228 results
  1. #108default of 22856.3%
  2. #172none of 22821.0%

Leader: GPT-5.2 · 99.0%

math

MATH 500 (Vals)

48 results
  1. #20medium of 4891.6%

Leader: Gemini 3 Pro · 96.4%

math

MATH-500

162 results
  1. #36default of 16294.7%
  2. #75none of 16285.0%

Leader: GPT-5 · 99.4%

math

MGSM (Vals)

62 results
  1. #11medium of 6293.0%

Leader: Opus 4.5 · 95.2%

other

Arena Vision

116 results
  1. #84medium of 1161193

Leader: Fable 5 · 1308

reasoning

CritPt

529 results
  1. #240default of 5290.9%
  2. #330none of 5290.0%

Leader: Muse Wonder Full (Max) · 32.9%

reasoning

LegalBench

135 results
  1. #66medium of 13582.5%

Leader: Fable 5 · 88.6%