priorsBuilder

OpenAI · released 2024-12-17

o1

Measured on 34 benchmarks.

General frontier

Not ranked in this mix — too little measured data for its benchmarks.

Your mix’s benchmarks

3 of 8 measured

reasoning

Humanity's Last Exam

587 results
  1. #361default of 5877.0%

Leader: Opus 5.5 · 61.4%

knowledge

AA-Omniscience

526 results
  1. #200default of 526-11.1

Leader: Opus 5.5 · 46.4

reasoning

SimpleBench

97 results
  1. #62high of 9741.7%
  2. #70medium of 9736.7%

Leader: Opus 5.5 · 88.4%

All 34 benchmarks

show 31 more

agentic

τ²-Bench Telecom

393 results
  1. #180default of 39362.6%

Leader: GLM 5.2 · 99.1%

coding

Drone-Bench

11 results
  1. #10high of 1131.9%

Leader: Opus 5.5 · 97.3%

coding

LiveCodeBench

282 results
  1. #75default of 28267.9%

Leader: Gemini 3 Pro · 91.7%

coding

LiveCodeBench (Vals)

127 results
  1. #106high of 12750.3%

Leader: Fable 5.1 · 90.5%

coding

Terminal-Bench Hard-AA

387 results
  1. #203default of 38712.9%

Leader: GPT-5.6 Sol · 65.9%

coding

WeirdML v2

127 results
  1. #68high of 12747.6%

Leader: GPT-6 Astra Pro · 93.6%

composite

AA Intelligence Index v4.3.2

610 results
  1. #283default of 61015.2

Leader: Opus 5.5 · 57.6

composite

Arena Text

220 results
  1. #120high of 2201402

Leader: Gemini 4 · 1525

composite

Arena Text — Multi-Turn

220 results
  1. #132high of 2201390

Leader: Gemini 4 · 1553

economics

TaxEval (Vals)

125 results
  1. #38high of 12574.3%

Leader: Muse Spark 1.2 · 80.4%

instruction

IFBench

399 results
  1. #67default of 39970.3%

Leader: Grok 4.3 · 83.3%

knowledge

AA-Omniscience Accuracy

526 results
  1. #156default of 52634.5%

Leader: Fable 5.1 · 67.2%

knowledge

AA-Omniscience Non-hallucination

526 results
  1. #215default of 52630.4%

Leader: MiniCPM5-1B (Non-reasoning) · 99.1%

knowledge

GPQA Diamond

539 results
  1. #229default of 53976.5%

Leader: GPT-6 Astra · 96.3%

knowledge

GPQA Diamond (Vals)

122 results
  1. #84high of 12273.2%

Leader: Gemini 3.1 Pro · 95.5%

knowledge

MedQA (Vals)

80 results
  1. #1high of 8096.5%

Leader: this model · 96.5%

knowledge

MMLU Pro (Vals)

122 results
  1. #69high of 12283.5%

Leader: Fable 5.1 · 92.4%

knowledge

MMLU-Pro

285 results
  1. #33default of 28584.8%

Leader: Gemini 3 Pro · 89.8%

knowledge

MMMU Pro (Vals)

81 results
  1. #51high of 8177.4%

Leader: Fable 5.1 · 90.6%

long-context

AA-LCR v1.1

523 results
  1. #244default of 52365.0%

Leader: Kimi K3 · 88.7%

math

AIME (Vals)

82 results
  1. #52high of 8271.5%

Leader: Gemini 3.1 Pro · 98.1%

math

AIME 2025

228 results
  1. #62default of 22879.7%

Leader: GPT-5.2 · 99.0%

math

FrontierMath Tiers 1–3 (v2)

115 results
  1. #99high of 11514.7%
  2. #102medium of 11510.2%
  3. #104low of 1158.4%

Leader: GPT-6.1 Sol · 93.7%

math

MATH 500 (Vals)

48 results
  1. #23high of 4890.4%

Leader: Gemini 3 Pro · 96.4%

math

MATH-500

162 results
  1. #24default of 16297.0%

Leader: GPT-5 · 99.4%

math

MGSM (Vals)

62 results
  1. #39high of 6289.3%

Leader: Opus 4.5 · 95.2%

other

Arena Vision

116 results
  1. #85high of 1161193

Leader: Fable 5 · 1308

reasoning

CritPt

529 results
  1. #278default of 5290.3%

Leader: Muse Wonder Full (Max) · 32.9%

reasoning

LegalBench

135 results
  1. #82high of 13580.4%

Leader: Fable 5 · 88.6%

reliability

Tool-call error rate

171 results
  1. #58high of 1710.7%

Leader: GPT-5.4 Pro · 0.0%

reliability

Uptime (7d)

181 results
  1. #3high of 181100.0%

Leader: GPT-5 Pro · 100.0%