Agents & computer use
AutomationBench-AA
- #119default of 25946.5%
Leader: Gemini 4 Carbon · 77.8%
Other · released 2026-07-09
Measured on 20 benchmarks.
19.0
#57 of 101 models
includes estimates: 35% of the mix is measured for this model
Bars show where JT-4.1 Flash 236B A21B 0709 (Reasoning) sits among the 101 ranked models on each benchmark (right is best); the tick is the field median.
Across 11 results on every current benchmark that measured JT-4.1 Flash 236B A21B 0709 (Reasoning), not only this ranking’s. The percentage is its average standing among the 101 models in this ranking that took the same benchmarks: 100% beat them all, 0% trailed them all. A benchmark in two categories counts in both; a category needs two benchmarks.
Not measured for JT-4.1 Flash 236B A21B 0709 (Reasoning): cost per task, time per task, output speed, time to first token, output tokens per task (no published API price yet).
Cost per task is what a subscriber pays: the model’s plan price, a share of API price. Models no plan sells are at API price.
Agents & computer use
Leader: Gemini 4 Carbon · 77.8%
Professional work
Leader: Sonnet 5.5 · 1816
Professional work
Leader: Gemini 4 Hydrogen · 32.8%
Agents & computer use
Leader: Kimi K3.1 · 67.2%