Benchmarks · agentic
τ^τ-bench (Hyper-τ), release v1 (Sierra)
A coding agent builds a working customer-service agent from realistic evidence (policies, transcripts, recordings, a client API), and is scored by how well that agent then serves simulated customers on 53 held-out tasks. Maintained by Sierra. Score: Overall: mean reward across all 53 release tasks of the agent the Developer built (τ³-bench inner loop).
5 models · 5 results · data as of 2026-10-29 · github.com ↗
Leaderboard
Opus 5 max
All results
5 rows| # | Model | Effort | Score | Harness |
|---|---|---|---|---|
| 1 | Opus 5 | max | 23.9% | Claude Code |
| 2 | GPT-5.6 Sol | xhigh | 22.0% | Codex |
| 3 | GPT-5.6 Terra | xhigh | 18.0% | Codex |
| 4 | Kimi K3 | max | 16.1% | OpenCode |
| 5 | Sonnet 5 | max | 14.9% | Claude Code |