Support

Settings

Theme

Explore themes

Mode

Library

Looks borrowed from benchmark sites and products. Themes with a light and a dark version follow your mode.

Bring your own theme

Upload a Priors theme file, or have your agent make one: copy the prompt, tell it the look you want, and upload what it returns. With the Priors skill installed it already knows the format.

Custom themes stay in this browser. They travel inside shared chart links and a page's theme, so others see them as you do.

For the builder, Explore and model pages on this device. Published pages keep the theme their owner picked.

Mode

Update notices

A note when a benchmark one of your indexes uses gets a new version, with a one-click upgrade.

Benchmarks · Coding · Agents & computer use

LongTail-SWE

Can a coding agent fix real GitHub issues in languages most benchmarks skip? 202 tasks across 13 languages, such as Elixir, OCaml and Haskell, three attempts each, with every model in the same agent setup. The share of attempts that pass the tests.

11 models · 11 results · data as of 2026-11-18 · longtail-swe.com ↗

Leaderboard

Opus 5.5 high

More from this benchmark

5 published measures

Breakdown

darker is better within each column · click a column to sort
Model
Opus 5.5 high89.674.31.2
GPT-6.1 Sol high85.676.70.7
Kimi K3.1 max87.164.41.5
GPT-5.6 Sol high87.663.91.3
DeepSeek V4.1 Flash 1017 max86.164.40.9
Kimi K3 max82.260.41.4
GPT-5.6 Luna xhigh84.257.40.6
DeepSeek V4 Flash high72.839.61.6
GLM 5.3 Flash max70.323.80.8
Qwen 3.8 27B xhigh62.920.80.8
Qwen 3.6 27B max23.89.410.7

All results

11 rows
#ModelEffortLongTail-SWEAgent stepsHarness
1Opus 5.5high82.0%53SWE-agent-like scaffold
2GPT-6.1 Solhigh81.8%27SWE-agent-like scaffold
3Kimi K3.1max77.2%50SWE-agent-like scaffold
4GPT-5.6 Solhigh76.2%34SWE-agent-like scaffold
5DeepSeek V4.1 Flash 1017max75.9%159SWE-agent-like scaffold
6Kimi K3max72.1%154SWE-agent-like scaffold
7GPT-5.6 Lunaxhigh71.8%77SWE-agent-like scaffold
8DeepSeek V4 Flashhigh56.8%200SWE-agent-like scaffold
9GLM 5.3 Flashmax48.4%314SWE-agent-like scaffold
10Qwen 3.8 27Bxhigh42.9%214SWE-agent-like scaffold
11Qwen 3.6 27Bmax16.5%113SWE-agent-like scaffold