Benchmarks · agentic
MCPMark Verified
AI agents complete realistic multi-step tasks through Model Context Protocol servers for Notion, GitHub, a filesystem, Postgres and a Playwright browser, each checked by the task's own verification script; Verified is the maintainers' version-pinned, stabilized 127-task set. Maintained by EVAL SYS. Score: Pass@1 in percent: the share of the 127 Verified tasks a single run of the model passes, each task decided by its automated verify.py.
8 models · 8 results · data as of 2026-10-29 · mcpmark.ai ↗
Leaderboard
Kimi K3 max
All results
8 rows| # | Model | Effort | MCPMark Verified |
|---|---|---|---|
| 1 | Kimi K3 | max | 96.1% |
| 2 | GPT-5.5 | xhigh | 92.9% |
| 3 | GPT-5.6 Sol | max | 92.9% |
| 4 | Fable 5 | max | 86.6% |
| 5 | Kimi K2.7 Code | max | 81.9% |
| 6 | Opus 4.8 | max | 76.4% |
| 7 | Kimi K2.6 | max | 72.8% |
| 8 | DeepSeek V4 Pro | max | 71.7% |