Benchmarks · coding
HumanEval
Uses LLM Stats / ZeroEval HumanEval pass@1 leaderboard. Score: HumanEval pass@1. Collected by Jake Boggs' benchmark dashboard.
42 models · 42 results · data as of 2026-10-29 · llm-stats.com ↗
Leaderboard
Kimi K2 medium
All results
42 rows| # | Model | Effort | HumanEval |
|---|---|---|---|
| 1 | Kimi K2 | medium | 94.5% |
| 2 | Sonnet 3.5 | medium | 93.7% |
| 3 | GPT-5 | high | 93.4% |
| 4 | Qwen 2.5 Coder | none | 92.7% |
| 5 | o1 mini | high | 92.4% |
| 6 | Mistral Large 2 | none | 92.0% |
| 7 | Qwen 2.5 | 91.5% | |
| 8 | GPT-4o | high | 90.2% |
| 9 | DeepSeek V2.5 | none | 89.0% |
| 10 | Llama 3.1 405b | none | 89.0% |
| 11 | Mistral Small 3.1 | none | 88.4% |
| 12 | Grok 2 | none | 88.4% |
| 13 | Llama 3.3 70b | none | 88.4% |
| 14 | Qwen 2.5 32B | none | 88.4% |
| 15 | Haiku 3.5 | medium | 88.1% |
| 16 | o1 | high | 88.1% |
| 17 | GPT-4.5 | 88.0% | |
| 18 | Gemma 3 27B | none | 87.8% |
| 19 | GPT-4o mini | high | 87.2% |
| 20 | GPT-4 | high | 87.1% |
| 21 | Qwen 2.5 72B | none | 86.6% |
| 22 | Qwen 2 72B | none | 86.0% |
| 23 | Grok 2 Mini | 85.7% | |
| 24 | Gemma 3 12B | none | 85.4% |
| 25 | Opus 3 | none | 84.9% |
| 26 | Mistral Small 3 | none | 84.8% |
| 27 | Qwen 2.5 7B | 84.8% | |
| 28 | Gemini 1.5 Pro | none | 84.1% |
| 29 | Qwen 2.5 14B | 83.5% | |
| 30 | Codestral | 81.1% |