Benchmarks · coding
SciCode
SciCode: implementing scientific research code from paper descriptions; sub-problem accuracy.
83 models · 165 results · data as of 2026-10-29 · artificialanalysis.ai ↗
Leaderboard
Opus 5.5 max
More from this benchmark
3 published measuresScore vs any published measure3 measures: sub-scores, splits, counts
Breakdown
darker is better within each column · click a column to sort| Model | |||
|---|---|---|---|
| Opus 5.5 max, fallback | 1,222,503 | 366,615 | 6,144,155 |
| Gemini 4 Carbon high | 4,249,956 | 160,343 | 9,196,155 |
| Fable 5.1 max, fallback | 1,196,326 | 257,078 | 3,296,726 |
| Gemini 4 Argon high | 1,437,250 | 112,988 | 2,643,094 |
| Sonnet 5.5 max, fallback | 1,170,592 | 273,839 | 7,498,720 |
| MiMo V2.6 Pro | 1,095,139 | 380,305 | 1,652,819 |
| Gemini 3.7 Flash medium | 672,246 | 112,728 | 522,976 |
| Muse Spark 1.3 xhigh | 795,883 | 168,116 | 2,116,326 |
| Kimi K3 max | 706,608 | 134,340 | 879,539 |
| GLM 5.3 max | 1,020,664 | 201,454 | 4,842,757 |
| Muse Spark 1.1 xhigh | 836,006 | 187,379 | 1,646,216 |
| GPT-5.6 Sol high | 690,024 | 123,084 | 247,031 |
| Grok 4.7 high | 659,420 | 107,513 | 4,439,722 |
| GPT-6 Sol max | 565,543 | 76,470 | 1,034,130 |
| Muse Spark 1.2 xhigh | 969,555 | 241,431 | 3,571,783 |
| Gemini 3.8 Flash high | 720,264 | 129,595 | 5,625,621 |
| GPT-6 Astra max | 660,069 | 115,195 | 1,090,604 |
| Grok 4.6 high | 653,668 | 101,310 | 985,361 |
| Opus 5 max | 1,158,185 | 249,702 | 874,716 |
| GPT-5.5 high | 745,068 | 143,681 | 759,843 |
| DeepSeek V4.1 Flash 1017 max | 709,919 | 137,217 | 3,559,853 |
| GPT-6.1 Sol high | 653,771 | 111,157 | 131,546 |
| GPT-6.1 Terra max | 673,062 | 126,498 | 3,954,324 |
| Haiku 5.5 max | 1,154,034 | 249,177 | 5,821,297 |
| GPT-5.6 Terra max | 724,982 | 104,859 | 2,519,748 |
All results
165 rows| # | Model | Effort | SciCode |
|---|---|---|---|
| 1 | Opus 5.5 | max | 66.9% |
| 2 | Opus 5.5 | xhigh | 65.0% |
| 3 | Gemini 4 Carbon | high | 64.2% |
| 4 | Fable 5.1 | max | 63.1% |
| 5 | Gemini 4 Argon | high | 61.8% |
| 6 | Sonnet 5.5 | max | 61.0% |
| 7 | Fable 5.1 | xhigh | 60.9% |
| 8 | MiMo V2.6 Pro | 60.9% | |
| 9 | Opus 5.5 | high | 60.4% |
| 10 | Gemini 3.7 Flash | medium | 59.8% |
| 11 | Muse Spark 1.3 | xhigh | 59.7% |
| 12 | Kimi K3 | max | 59.5% |
| 13 | Opus 5.5 | medium | 59.3% |
| 14 | GLM 5.3 | max | 59.0% |
| 15 | Muse Spark 1.1 | xhigh | 58.8% |
| 16 | Muse Spark 1.3 | max | 58.8% |
| 17 | Fable 5.1 | high | 58.7% |
| 18 | Opus 5.5 | low | 58.6% |
| 19 | GPT-5.6 Sol | high | 57.8% |
| 20 | Grok 4.7 | high | 57.8% |
| 21 | GPT-6 Sol | max | 57.6% |
| 22 | GPT-5.6 Sol | medium | 57.4% |
| 23 | Grok 4.7 | xhigh | 57.4% |
| 24 | Muse Spark 1.2 | xhigh | 57.4% |
| 25 | Sonnet 5.5 | xhigh | 57.3% |
| 26 | Gemini 3.7 Flash | high | 57.2% |
| 27 | GPT-5.6 Sol | max | 57.1% |
| 28 | GPT-5.6 Sol | xhigh | 57.1% |
| 29 | Fable 5.1 | low | 56.7% |
| 30 | Gemini 3.8 Flash | high | 56.6% |