priorsBuilder

OpenAI · released 2025-11-13

GPT-5.1

Measured on 62 benchmarks.

General frontier

Not ranked in this mix — too little measured data for its benchmarks.

Your mix’s benchmarks

4 of 8 measured

reasoning

Humanity's Last Exam

587 results
  1. #158high of 58728.5%
  2. #424none of 5875.3%

Leader: Opus 5.5 · 61.4%

knowledge

AA-Omniscience

526 results
  1. #102high of 5265.4
  2. #288none of 526-34.5

Leader: Opus 5.5 · 46.4

reasoning

BullshitBench v2

196 results
  1. #91medium of 19645.0%

Leader: Opus 4.8 · 95.0%

reasoning

SimpleBench

97 results
  1. #48high of 9753.2%

Leader: Opus 5.5 · 88.4%

All 62 benchmarks

show 58 more

agentic

Terminal-Bench 2.0

40 results
  1. #17high of 4047.6%

Leader: GPT-5.5 · 84.7%

agentic

Vending-Bench 2

67 results
  1. #51high of 67$1,473

Leader: GPT-6 Astra · $15,515

agentic

τ²-Bench Telecom

393 results
  1. #115high of 39381.9%
  2. #211none of 39346.5%

Leader: GLM 5.2 · 99.1%

agentic

τ³-Banking

206 results
  1. #114high of 20615.9%

Leader: Qwen 3.8 Max · 51.3%

coding

Arena Image-to-WebDev

58 results
  1. #53high of 581421

Leader: Opus 5.5 · 1749

coding

Arena WebDev

122 results
  1. #86medium of 1221395
  2. #100high of 1221342

Leader: Opus 5.5 · 1813

coding

LiveCodeBench

282 results
  1. #9high of 28286.8%
  2. #128none of 28249.4%

Leader: Gemini 3 Pro · 91.7%

coding

LiveCodeBench (Vals)

127 results
  1. #22high of 12786.5%

Leader: Fable 5.1 · 90.5%

coding

SWE-bench Verified (Vals)

85 results
  1. #62high of 8569.8%

Leader: Opus 5 · 97.0%

coding

Terminal-Bench 2.0 (Vals)

63 results
  1. #24high of 6344.9%

Leader: GPT-5.5 · 73.2%

coding

Terminal-Bench Hard-AA

387 results
  1. #35high of 38745.5%
  2. #153none of 38722.7%

Leader: GPT-5.6 Sol · 65.9%

coding

Terminal-Bench v2.1-AA

238 results
  1. #114high of 23852.4%

Leader: Fable 5.1 · 91.4%

coding

Vibe Code Bench v1.1

105 results
  1. #68high of 10524.6%

Leader: Sonnet 5.5 · 92.4%

coding

WeirdML v2

127 results
  1. #43high of 12760.8%

Leader: GPT-6 Astra Pro · 93.6%

composite

AA Intelligence Index v4.3.2

610 results
  1. #167high of 61024.7
  2. #306none of 61013.3

Leader: Opus 5.5 · 57.6

composite

Arena Text

220 results
  1. #60high of 2201456

Leader: Gemini 4 · 1525

composite

Arena Text — Multi-Turn

220 results
  1. #63high of 2201464

Leader: Gemini 4 · 1553

creative

VoxelBench (image)

16 results
  1. #13high of 161167

Leader: GPT-6.1 Sol · 2214

creative

VoxelBench (text)

55 results
  1. #53high of 551166

Leader: GPT-6 Astra · 2732

economics

CorpFin (Vals)

117 results
  1. #41high of 11763.8%

Leader: Opus 5 · 73.2%

economics

GDPval-AA v2.1

288 results
  1. #182high of 288826

Leader: Opus 5.5 · 1866

economics

MortgageTax (Vals)

84 results
  1. #57high of 8461.4%

Leader: Opus 5 · 72.1%

economics

TaxEval (Vals)

125 results
  1. #27high of 12574.9%

Leader: Muse Spark 1.2 · 80.4%

instruction

IFBench

399 results
  1. #45high of 39972.9%
  2. #225none of 39943.2%

Leader: Grok 4.3 · 83.3%

knowledge

AA-Omniscience Accuracy

526 results
  1. #137high of 52637.7%
  2. #183none of 52629.5%

Leader: Fable 5.1 · 67.2%

knowledge

AA-Omniscience Non-hallucination

526 results
  1. #124high of 52648.1%
  2. #409none of 5269.4%

Leader: MiniCPM5-1B (Non-reasoning) · 99.1%

knowledge

Arena Search

28 results
  1. #13high of 281199

Leader: GPT-5.6 Sol · 1257

knowledge

CaseLaw (Vals)

53 results
  1. #2high of 5373.4%

Leader: Grok 4.3 · 79.3%

knowledge

Global-MMLU-Lite

118 results
  1. #10high of 11890.6%

Leader: Gemini 3.1 Pro · 93.2%

knowledge

GPQA Diamond

539 results
  1. #100high of 53987.3%
  2. #338none of 53964.3%

Leader: GPT-6 Astra · 96.3%

knowledge

GPQA Diamond (Vals)

122 results
  1. #41high of 12286.6%

Leader: Gemini 3.1 Pro · 95.5%

knowledge

MedCode

94 results
  1. #13high of 9452.7%

Leader: Opus 5 · 63.6%

knowledge

MedQA (Vals)

80 results
  1. #2high of 8096.4%

Leader: o1 · 96.5%

knowledge

MedScribe

96 results
  1. #13high of 9688.1%

Leader: Opus 5.5 · 91.4%

knowledge

MMLU Pro (Vals)

122 results
  1. #41high of 12286.4%

Leader: Fable 5.1 · 92.4%

knowledge

MMLU-Pro

285 results
  1. #13high of 28587.0%
  2. #95none of 28580.1%

Leader: Gemini 3 Pro · 89.8%

knowledge

MMMU Pro (Vals)

81 results
  1. #33high of 8183.2%

Leader: Fable 5.1 · 90.6%

knowledge

MMMU-Pro

265 results
  1. #94high of 26575.5%
  2. #187none of 26562.4%

Leader: Opus 5.5 · 87.7%

long-context

AA-LCR v1.1

523 results
  1. #84high of 52380.0%
  2. #321none of 52345.0%

Leader: Kimi K3 · 88.7%

long-context

Arena Document

43 results
  1. #41high of 431403

Leader: Opus 5 · 1516

math

AIME (Vals)

82 results
  1. #15high of 8293.3%

Leader: Gemini 3.1 Pro · 98.1%

math

AIME 2025

228 results
  1. #14high of 22894.0%
  2. #140none of 22838.0%

Leader: GPT-5.2 · 99.0%

math

MGSM (Vals)

62 results
  1. #10high of 6293.0%

Leader: Opus 4.5 · 95.2%

other

Arena Vision

116 results
  1. #50high of 1161251

Leader: Fable 5 · 1308

other

Poker Agent

17 results
  1. #9high of 171039

Leader: GPT-5.2 · 1132

other

T3 Code usage share

85 results
  1. #69high of 850.0%

Leader: Opus 5.5 · 29.1%

reasoning

ARC-AGI-1

215 results
  1. #119high of 21572.8%
  2. #142medium of 21557.7%
  3. #175low of 21533.2%
  4. #202none of 2155.8%

Leader: Fable 5 · 98.5%

reasoning

ARC-AGI-2

216 results
  1. #128high of 21617.6%
  2. #147medium of 2166.5%
  3. #177low of 2161.9%
  4. #201none of 2160.4%

Leader: GPT-6 Astra · 95.0%

reasoning

CritPt

529 results
  1. #156high of 5294.9%
  2. #341none of 5290.0%

Leader: Muse Wonder Full (Max) · 32.9%

reasoning

LegalBench

135 results
  1. #19high of 13585.7%

Leader: Fable 5 · 88.6%

reasoning

SAGE

80 results
  1. #50high of 8043.2%

Leader: Opus 4.7 · 56.1%

reasoning

SimpleQA Verified

47 results
  1. #24high of 4734.9%

Leader: Gemini 3.1 Pro · 77.5%

reliability

Tool-call error rate

171 results
  1. #32high of 1710.3%

Leader: GPT-5.4 Pro · 0.0%

reliability

Uptime (7d)

181 results
  1. #30high of 181100.0%

Leader: GPT-5 Pro · 100.0%

speed

Latency (Time to First Token)

351 results
  1. #61none of 3511.0s
  2. #300high of 35132s

Leader: Gemini 2.5 Flash-Lite · 0.3s

speed

Output Speed (tokens/s)

351 results
  1. #128high of 351116.5
  2. #141none of 351110.3

Leader: Celeris-1 · 1522.5

speed

Provider latency

177 results
  1. #79high of 1771.2s

Leader: Qwen 2.5 7B · 0.2s

speed

Provider throughput

176 results
  1. #50high of 17683.0

Leader: Muse Spark 1.1 · 204.3