priorsBuilder

Mistral · released 2025-12-02

Mistral Large 3

Measured on 53 benchmarks.

General frontier

Not ranked in this mix — too little measured data for its benchmarks.

Your mix’s benchmarks

3 of 8 measured

reasoning

Humanity's Last Exam

587 results
  1. #513none of 5874.2%

Leader: Opus 5.5 · 61.4%

knowledge

AA-Omniscience

526 results
  1. #309none of 526-39.6

Leader: Opus 5.5 · 46.4

reasoning

SimpleBench

97 results
  1. #91none of 9720.4%

Leader: Opus 5.5 · 88.4%

All 53 benchmarks

show 50 more

agentic

AA-Briefcase v1.1

224 results
  1. #197none of 224228

Leader: Sonnet 5.5 · 1823

agentic

AutomationBench-AA

219 results
  1. #183none of 2191.5%

Leader: Gemini 4 · 77.5%

agentic

τ²-Bench Telecom

393 results
  1. #294none of 39324.6%

Leader: GLM 5.2 · 99.1%

agentic

τ³-Banking

206 results
  1. #175none of 2065.8%

Leader: Qwen 3.8 Max · 51.3%

coding

Arena Image-to-WebDev

58 results
  1. #56none of 581362

Leader: Opus 5.5 · 1749

coding

Arena WebDev

122 results
  1. #116none of 1221230

Leader: Opus 5.5 · 1813

coding

LiveCodeBench

282 results
  1. #137none of 28246.5%

Leader: Gemini 3 Pro · 91.7%

coding

LiveCodeBench (Vals)

127 results
  1. #102none of 12755.3%

Leader: Fable 5.1 · 90.5%

coding

SciCode

226 results
  1. #189none of 22636.6%

Leader: Opus 5.5 · 66.9%

coding

SWE-bench Verified (Vals)

85 results
  1. #83none of 8541.4%

Leader: Opus 5 · 97.0%

coding

Terminal-Bench 2.0 (Vals)

63 results
  1. #61none of 639.0%

Leader: GPT-5.5 · 73.2%

coding

Terminal-Bench Hard-AA

387 results
  1. #190none of 38715.9%

Leader: GPT-5.6 Sol · 65.9%

coding

Terminal-Bench v2.1-AA

238 results
  1. #193none of 23812.0%

Leader: Fable 5.1 · 91.4%

coding

Terminal-Bench v4-AA

216 results
  1. #193none of 2160.0%

Leader: Sonnet 5.5 · 63.6%

composite

AA Intelligence Index v4.3.2

610 results
  1. #389none of 6109.3

Leader: Opus 5.5 · 57.6

composite

Arena Text

220 results
  1. #111none of 2201414

Leader: Gemini 4 · 1525

composite

Arena Text — Multi-Turn

220 results
  1. #106none of 2201420

Leader: Gemini 4 · 1553

cost

AA Intelligence Index Cost per Task

177 results
  1. #19none of 177$0.03

Leader: GPT-6 Luna · $0.00

cost

Cost to Run AA Intelligence Index

177 results
  1. #16none of 177$46.41

Leader: GPT-6 Luna · $10.63

economics

CorpFin (Vals)

117 results
  1. #61none of 11761.0%

Leader: Opus 5 · 73.2%

economics

GDP.pdf

210 results
  1. #191none of 2101.2%

Leader: Muse Wonder Full (Max) · 32.6%

economics

GDPval-AA v2.1

288 results
  1. #226none of 288420

Leader: Opus 5.5 · 1866

economics

MortgageTax (Vals)

84 results
  1. #73none of 8452.1%

Leader: Opus 5 · 72.1%

economics

TaxEval (Vals)

125 results
  1. #52none of 12573.1%

Leader: Muse Spark 1.2 · 80.4%

instruction

IFBench

399 results
  1. #293none of 39936.2%

Leader: Grok 4.3 · 83.3%

knowledge

AA-Omniscience Accuracy

526 results
  1. #224none of 52624.9%

Leader: Fable 5.1 · 67.2%

knowledge

AA-Omniscience Non-hallucination

526 results
  1. #349none of 52614.0%

Leader: MiniCPM5-1B (Non-reasoning) · 99.1%

knowledge

CaseLaw (Vals)

53 results
  1. #21none of 5361.4%

Leader: Grok 4.3 · 79.3%

knowledge

Global-MMLU-Lite

118 results
  1. #70none of 11880.3%

Leader: Gemini 3.1 Pro · 93.2%

knowledge

GPQA Diamond

539 results
  1. #307none of 53968.0%

Leader: GPT-6 Astra · 96.3%

knowledge

GPQA Diamond (Vals)

122 results
  1. #93none of 12268.4%

Leader: Gemini 3.1 Pro · 95.5%

knowledge

MedQA (Vals)

80 results
  1. #57none of 8082.2%

Leader: o1 · 96.5%

knowledge

MMLU Pro (Vals)

122 results
  1. #87none of 12279.8%

Leader: Fable 5.1 · 92.4%

knowledge

MMLU-Pro

285 results
  1. #85none of 28580.7%

Leader: Gemini 3 Pro · 89.8%

knowledge

MMMU Pro (Vals)

81 results
  1. #66none of 8166.2%

Leader: Fable 5.1 · 90.6%

knowledge

MMMU-Pro

265 results
  1. #212none of 26555.7%

Leader: Opus 5.5 · 87.7%

long-context

AA-LCR v1.1

523 results
  1. #359none of 52336.0%

Leader: Kimi K3 · 88.7%

math

AIME (Vals)

82 results
  1. #61none of 8242.9%

Leader: Gemini 3.1 Pro · 98.1%

math

AIME 2025

228 results
  1. #141none of 22838.0%

Leader: GPT-5.2 · 99.0%

math

MGSM (Vals)

62 results
  1. #55none of 6285.4%

Leader: Opus 4.5 · 95.2%

other

Arena Vision

116 results
  1. #81none of 1161200

Leader: Fable 5 · 1308

reasoning

CritPt

529 results
  1. #393none of 5290.0%

Leader: Muse Wonder Full (Max) · 32.9%

reasoning

LegalBench

135 results
  1. #91none of 13579.1%

Leader: Fable 5 · 88.6%

reasoning

SAGE

80 results
  1. #79none of 8024.6%

Leader: Opus 4.7 · 56.1%

reliability

Tool-call error rate

171 results
  1. #86none of 1711.3%

Leader: GPT-5.4 Pro · 0.0%

reliability

Uptime (7d)

181 results
  1. #58none of 18199.9%

Leader: GPT-5 Pro · 100.0%

speed

Latency (Time to First Token)

351 results
  1. #86none of 3511.1s

Leader: Gemini 2.5 Flash-Lite · 0.3s

speed

Output Speed (tokens/s)

351 results
  1. #223none of 35173.5

Leader: Celeris-1 · 1522.5

speed

Provider latency

177 results
  1. #25none of 1770.6s

Leader: Qwen 2.5 7B · 0.2s

speed

Provider throughput

176 results
  1. #97none of 17657.5

Leader: Muse Spark 1.1 · 204.3