priorsBuilder

DeepSeek · released 2025-05-28

DeepSeek R1

Measured on 45 benchmarks.

General frontier

Not ranked in this mix — too little measured data for its benchmarks.

Your mix’s benchmarks

4 of 8 measured

reasoning

Humanity's Last Exam

587 results
  1. #241default of 58715.8%

Leader: Opus 5.5 · 61.4%

knowledge

AA-Omniscience

526 results
  1. #265default of 526-27.4

Leader: Opus 5.5 · 46.4

reasoning

BullshitBench v2

196 results
  1. #183xhigh of 1968.0%
  2. #186none of 1967.0%

Leader: Opus 4.8 · 95.0%

reasoning

SimpleBench

97 results
  1. #66xhigh of 9740.8%

Leader: Opus 5.5 · 88.4%

All 45 benchmarks

show 41 more

agentic

AA-Briefcase v1.1

224 results
  1. #204default of 224128

Leader: Sonnet 5.5 · 1823

agentic

AutomationBench-AA

219 results
  1. #210default of 2190.2%

Leader: Gemini 4 · 77.5%

agentic

τ²-Bench Telecom

393 results
  1. #232default of 39336.5%

Leader: GLM 5.2 · 99.1%

agentic

τ³-Banking

206 results
  1. #168default of 2066.4%

Leader: Qwen 3.8 Max · 51.3%

coding

LiveCodeBench

282 results
  1. #35default of 28277.0%

Leader: Gemini 3 Pro · 91.7%

coding

LiveCodeBench (Vals)

127 results
  1. #87xhigh of 12770.2%

Leader: Fable 5.1 · 90.5%

coding

SciCode

226 results
  1. #183default of 22638.3%

Leader: Opus 5.5 · 66.9%

coding

Terminal-Bench Hard-AA

387 results
  1. #189default of 38715.9%

Leader: GPT-5.6 Sol · 65.9%

coding

Terminal-Bench v2.1-AA

238 results
  1. #179default of 23819.1%

Leader: Fable 5.1 · 91.4%

coding

Terminal-Bench v4-AA

216 results
  1. #185default of 2160.0%

Leader: Sonnet 5.5 · 63.6%

coding

WeirdML v2

127 results
  1. #102xhigh of 12736.5%

Leader: GPT-6 Astra Pro · 93.6%

composite

AA Intelligence Index v4.3.2

610 results
  1. #312default of 61013.1

Leader: Opus 5.5 · 57.6

composite

Arena Text

220 results
  1. #123xhigh of 2201398

Leader: Gemini 4 · 1525

composite

Arena Text — Multi-Turn

220 results
  1. #117xhigh of 2201410

Leader: Gemini 4 · 1553

cost

AA Intelligence Index Cost per Task

177 results
  1. #65default of 177$0.26

Leader: GPT-6 Luna · $0.00

cost

Cost to Run AA Intelligence Index

177 results
  1. #67default of 177$461

Leader: GPT-6 Luna · $10.63

economics

CorpFin (Vals)

117 results
  1. #89xhigh of 11754.1%

Leader: Opus 5 · 73.2%

economics

GDP.pdf

210 results
  1. #181default of 2102.4%

Leader: Muse Wonder Full (Max) · 32.6%

economics

GDPval-AA v2.1

288 results
  1. #241default of 288295

Leader: Opus 5.5 · 1866

economics

TaxEval (Vals)

125 results
  1. #63xhigh of 12572.3%

Leader: Muse Spark 1.2 · 80.4%

instruction

IFBench

399 results
  1. #258default of 39939.6%

Leader: Grok 4.3 · 83.3%

knowledge

AA-Omniscience Accuracy

526 results
  1. #175default of 52630.5%

Leader: Fable 5.1 · 67.2%

knowledge

AA-Omniscience Non-hallucination

526 results
  1. #285default of 52618.9%

Leader: MiniCPM5-1B (Non-reasoning) · 99.1%

knowledge

Global-MMLU-Lite

118 results
  1. #33default of 11886.0%

Leader: Gemini 3.1 Pro · 93.2%

knowledge

GPQA Diamond

539 results
  1. #179default of 53981.3%

Leader: GPT-6 Astra · 96.3%

knowledge

MedQA (Vals)

80 results
  1. #39xhigh of 8090.8%

Leader: o1 · 96.5%

knowledge

MMLU Pro (Vals)

122 results
  1. #70xhigh of 12283.2%

Leader: Fable 5.1 · 92.4%

knowledge

MMLU-Pro

285 results
  1. #31default of 28584.9%

Leader: Gemini 3 Pro · 89.8%

long-context

AA-LCR v1.1

523 results
  1. #280default of 52357.7%

Leader: Kimi K3 · 88.7%

math

AIME (Vals)

82 results
  1. #51xhigh of 8274.0%

Leader: Gemini 3.1 Pro · 98.1%

math

AIME 2025

228 results
  1. #72default of 22876.0%

Leader: GPT-5.2 · 99.0%

math

MATH 500 (Vals)

48 results
  1. #17xhigh of 4892.2%

Leader: Gemini 3 Pro · 96.4%

math

MATH-500

162 results
  1. #13default of 16298.3%

Leader: GPT-5 · 99.4%

math

MGSM (Vals)

62 results
  1. #17xhigh of 6292.3%

Leader: Opus 4.5 · 95.2%

reasoning

ARC-AGI-1

215 results
  1. #184xhigh of 21521.2%

Leader: Fable 5 · 98.5%

reasoning

ARC-AGI-2

216 results
  1. #186xhigh of 2161.3%

Leader: GPT-6 Astra · 95.0%

reasoning

CritPt

529 results
  1. #212default of 5291.4%

Leader: Muse Wonder Full (Max) · 32.9%

reasoning

LegalBench

135 results
  1. #121xhigh of 13567.3%

Leader: Fable 5 · 88.6%

reasoning

SimpleQA Verified

47 results
  1. #31xhigh of 4728.6%

Leader: Gemini 3.1 Pro · 77.5%

speed

Latency (Time to First Token)

351 results
  1. #90default of 3511.1s

Leader: Gemini 2.5 Flash-Lite · 0.3s

speed

Output Speed (tokens/s)

351 results
  1. #90default of 351155.1

Leader: Celeris-1 · 1522.5