priorsBuilder

OpenAI · released 2024-07-18

GPT-4o mini

Measured on 39 benchmarks.

General frontier

Not ranked in this mix — too little measured data for its benchmarks.

Your mix’s benchmarks

3 of 8 measured

reasoning

Humanity's Last Exam

587 results
  1. #509none of 5874.2%

Leader: Opus 5.5 · 61.4%

reasoning

BullshitBench v2

196 results
  1. #196medium of 1962.0%

Leader: Opus 4.8 · 95.0%

reasoning

SimpleBench

97 results
  1. #96high of 9710.7%

Leader: Opus 5.5 · 88.4%

All 39 benchmarks

show 36 more

agentic

τ³-Banking

206 results
  1. #202none of 2062.9%

Leader: Qwen 3.8 Max · 51.3%

coding

LiveCodeBench

282 results
  1. #211none of 28223.4%

Leader: Gemini 3 Pro · 91.7%

coding

LiveCodeBench (Vals)

127 results
  1. #123high of 12726.4%

Leader: Fable 5.1 · 90.5%

coding

Terminal-Bench v2.1-AA

238 results
  1. #206none of 2385.6%

Leader: Fable 5.1 · 91.4%

coding

WeirdML v2

127 results
  1. #122high of 12711.8%

Leader: GPT-6 Astra Pro · 93.6%

composite

AA Intelligence Index v4.3.2

610 results
  1. #493none of 6106.7

Leader: Opus 5.5 · 57.6

composite

Arena Text

220 results
  1. #175high of 2201318

Leader: Gemini 4 · 1525

composite

Arena Text — Multi-Turn

220 results
  1. #176high of 2201311

Leader: Gemini 4 · 1553

economics

CorpFin (Vals)

117 results
  1. #104high of 11745.5%

Leader: Opus 5 · 73.2%

economics

GDPval-AA v2.1

288 results
  1. #265none of 288-23

Leader: Opus 5.5 · 1866

economics

MortgageTax (Vals)

84 results
  1. #70high of 8454.5%

Leader: Opus 5 · 72.1%

economics

TaxEval (Vals)

125 results
  1. #113high of 12560.5%

Leader: Muse Spark 1.2 · 80.4%

instruction

IFBench

399 results
  1. #338none of 39931.0%

Leader: Grok 4.3 · 83.3%

knowledge

GPQA Diamond

539 results
  1. #448none of 53942.6%

Leader: GPT-6 Astra · 96.3%

knowledge

GPQA Diamond (Vals)

122 results
  1. #115high of 12244.2%

Leader: Gemini 3.1 Pro · 95.5%

knowledge

MedQA (Vals)

80 results
  1. #67high of 8072.4%

Leader: o1 · 96.5%

knowledge

MMLU Pro (Vals)

122 results
  1. #118high of 12262.7%

Leader: Fable 5.1 · 92.4%

knowledge

MMLU-Pro

285 results
  1. #207none of 28564.8%

Leader: Gemini 3 Pro · 89.8%

knowledge

MMMU Pro (Vals)

81 results
  1. #77high of 8156.6%

Leader: Fable 5.1 · 90.6%

knowledge

MMMU-Pro

265 results
  1. #248none of 26541.5%

Leader: Opus 5.5 · 87.7%

long-context

MLCR-AA

94 results
  1. #94none of 940.0%

Leader: Sonnet 5.5 · 75.0%

math

AIME (Vals)

82 results
  1. #75high of 8211.5%

Leader: Gemini 3.1 Pro · 98.1%

math

AIME 2025

228 results
  1. #183none of 22814.7%

Leader: GPT-5.2 · 99.0%

math

FrontierMath Tiers 1–3 (v2)

115 results
  1. #112high of 1150.7%

Leader: GPT-6.1 Sol · 93.7%

math

MATH 500 (Vals)

48 results
  1. #40high of 4872.6%

Leader: Gemini 3 Pro · 96.4%

math

MATH-500

162 results
  1. #89none of 16278.9%

Leader: GPT-5 · 99.4%

math

MGSM (Vals)

62 results
  1. #52high of 6286.2%

Leader: Opus 4.5 · 95.2%

other

Arena Vision

116 results
  1. #108high of 1161097

Leader: Fable 5 · 1308

reasoning

ARC-AGI-2

216 results
  1. #203high of 2160.0%

Leader: GPT-6 Astra · 95.0%

reasoning

SimpleQA Verified

47 results
  1. #43high of 479.1%

Leader: Gemini 3.1 Pro · 77.5%

reliability

Tool-call error rate

171 results
  1. #136high of 1714.6%

Leader: GPT-5.4 Pro · 0.0%

reliability

Uptime (7d)

181 results
  1. #55high of 18199.9%

Leader: GPT-5 Pro · 100.0%

speed

Latency (Time to First Token)

351 results
  1. #31none of 3510.8s

Leader: Gemini 2.5 Flash-Lite · 0.3s

speed

Output Speed (tokens/s)

351 results
  1. #117none of 351124.2

Leader: Celeris-1 · 1522.5

speed

Provider latency

177 results
  1. #52high of 1770.9s

Leader: Qwen 2.5 7B · 0.2s

speed

Provider throughput

176 results
  1. #51high of 17683.0

Leader: Muse Spark 1.1 · 204.3