Benchmarks · Coding · Agents & computer use
LongTail-SWE: Haskell
LongTail-SWE's Haskell tasks: fix real GitHub issues in Haskell projects. The share of attempts that pass the tests.
11 models · 11 results · data as of 2026-11-18 · longtail-swe.com ↗
Leaderboard
GPT-6.1 Sol high
All results
11 rows| # | Model | Effort | LongTail-SWE: Haskell | Harness |
|---|---|---|---|---|
| 1 | GPT-6.1 Sol | high | 95.2% | SWE-agent-like scaffold |
| 2 | Kimi K3.1 | max | 95.2% | SWE-agent-like scaffold |
| 3 | Opus 5.5 | high | 92.9% | SWE-agent-like scaffold |
| 4 | DeepSeek V4.1 Flash 1017 | max | 85.7% | SWE-agent-like scaffold |
| 5 | GPT-5.6 Luna | xhigh | 83.3% | SWE-agent-like scaffold |
| 6 | GPT-5.6 Sol | high | 83.3% | SWE-agent-like scaffold |
| 7 | Kimi K3 | max | 83.3% | SWE-agent-like scaffold |
| 8 | DeepSeek V4 Flash | high | 78.6% | SWE-agent-like scaffold |
| 9 | GLM 5.3 Flash | max | 66.7% | SWE-agent-like scaffold |
| 10 | Qwen 3.8 27B | xhigh | 52.4% | SWE-agent-like scaffold |
| 11 | Qwen 3.6 27B | max | 26.2% | SWE-agent-like scaffold |