Agents / Benchmark profile
A breaking 66-task release of the continuously versioned terminal-agent benchmark with calibrated resources, a flat eight-hour agent timeout, eight task removals, and 19 task fixes.
This benchmark is registered, but the current snapshot has no qualifying results for the model cohort.
Not evaluated for the selected model cohort| Model | Result | Execution & attribution | Original source |
|---|---|---|---|
| SWE-2Terminal-Bench 4 · Cognition release table | 27.3percent (published) | Release-table configuration; per-model effort and harness vary. See original footnotes.provider subjectSource-native comparison only. Different settings are not silently substituted into retained index protocols. | Cognition ↗Published 2026-09-10 · checked 2026-09-16 |
| Kimi K3Terminal-Bench 4 · Cognition release table | 21.5percent (published) | Release-table configuration; per-model effort and harness vary. See original footnotes.provider measured competitorSource-native comparison only. Different settings are not silently substituted into retained index protocols. | Cognition ↗Published 2026-09-10 · checked 2026-09-16 |
| GPT-5.6 SolTerminal-Bench 4 · Cognition release table | 37.3percent (published) | Release-table configuration; per-model effort and harness vary. See original footnotes.provider measured competitorSource-native comparison only. Different settings are not silently substituted into retained index protocols. | Cognition ↗Published 2026-09-10 · checked 2026-09-16 |
| Fable 5.1Terminal-Bench 4 · Cognition release table | 55.8percent (published) | Release-table configuration; per-model effort and harness vary. See original footnotes.provider measured competitorSource-native comparison only. Different settings are not silently substituted into retained index protocols. | Cognition ↗Published 2026-09-10 · checked 2026-09-16 |
| GPT-6 AstraTerminal-Bench 4 · Cognition release table | 57.9percent (published) | Release-table configuration; per-model effort and harness vary. See original footnotes.provider measured competitorSource-native comparison only. Different settings are not silently substituted into retained index protocols. | Cognition ↗Published 2026-09-10 · checked 2026-09-16 |
| Grok 4.6Terminal-Bench 4 · Cognition release table | 20.3percent (published) | Release-table configuration; per-model effort and harness vary. See original footnotes.provider measured competitorSource-native comparison only. Different settings are not silently substituted into retained index protocols. | Cognition ↗Published 2026-09-10 · checked 2026-09-16 |
| Qwen3.8 Max (0902)terminalBench40 · exact AA profile b112af07-3bd5-4647-b09f-b23204361bb2 | 38.889percent | AA current published profile; effort label not exportedindependent evaluatorRetained as additional evidence. Existing Core point is unchanged pending an accepted complete own-evidence amendment; incompatible versions remain separate. | Artificial Analysis ↗Publication date not recorded · checked 2026-09-16 |
| SWE-1.7Terminal-Bench 4 · Cognition release table | 7.6percent (published) | Release-table configuration; per-model effort and harness vary. See original footnotes.provider subjectSource-native comparison only. Different settings are not silently substituted into retained index protocols. | Cognition ↗Published 2026-09-10 · checked 2026-09-16 |
From result to context
A breaking 66-task release of the continuously versioned terminal-agent benchmark with calibrated resources, a flat eight-hour agent timeout, eight task removals, and 19 task fixes.
The summary shows one best compatible source result per canonical product. Versions, effort settings and execution systems remain attached to the underlying records.
Scores from different versions or harnesses may not be interchangeable. The published source rows preserve those distinctions and their original units. A source result is not automatically an input to a current index.
A reviewed track from this benchmark is represented in the following current indices. Each index applies its own protocol and eligibility rules.
Contamination risk: Unknown. Lifecycle: Review Pending.
