Model profile / OpenAI
o4-mini is tracked via Artificial Analysis independent evaluations for capability comparison across coding, agents, reasoning and related workloads.
Four areas of evidence
Mathematical and scientific problem solving.
Score uses the admitted direct native evidence under the selected method.
Software engineering and programming.
Factual reliability and instruction following.
Tool use, workflows and professional tasks.
Current index snapshot · 2026-09-16. Each category uses its own scale; scores across categories are not directly comparable. Counts describe published catalogue evidence. A point lead does not establish superiority.
Performance in context
o4-mini has no current Capabilities rating. Explore the rated models below.
Lumina Capabilities Index
The current Capabilities cohort, with available operational measurements.
Chart loads as you explore
Lumina Capabilities Index
The current Capabilities cohort, with available operational measurements.
Chart loads as you explore
Explore the detail
Score uses the admitted direct native evidence under the selected method.
| Benchmark | Result | Published configuration | Source |
|---|---|---|---|
| FrontierMath v2 Tier 42026 | 6.25% | Exact BenchLM registry variant o4-mini (high); bulk export does not retain a complete upstream harness configuration.Source-native system | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21source-checked · reference-only |
| FrontierMath v2 Tier 42026 | 6.25% | Exact BenchLM registry variant o4-mini (high); bulk export does not retain a complete upstream harness configuration.Source-native system | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27source-checked · reference-only |
| FrontierMath v2 Tier 42026 | 6.25% | Exact BenchLM registry variant o4-mini (high); bulk export does not retain a complete upstream harness configuration.Source-native system | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01source-checked · reference-only |
| FrontierMath v2 Tiers 1-32026 | 24.828% | Exact BenchLM registry variant o4-mini (high); bulk export does not retain a complete upstream harness configuration.Source-native system | BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21source-checked · reference-only |
| FrontierMath v2 Tiers 1-32026 | 24.828% | Exact BenchLM registry variant o4-mini (high); bulk export does not retain a complete upstream harness configuration.Source-native system | BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27source-checked · reference-only |
| FrontierMath v2 Tiers 1-32026 | 24.828% | Exact BenchLM registry variant o4-mini (high); bulk export does not retain a complete upstream harness configuration.Source-native system | BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01source-checked · reference-only |
| FrontierMath v2 Tiers 1-3v2 / task implementation 2.0.0 | 36.14% | o4-mini (high)Epoch AI benchmark runner | Epoch AI permanent refresh source ↗Observed 2026-06-11 · checked 2026-08-17source-checked · excluded |
| FrontierMath v2 Tier 4v2 / task implementation 2.0.0 | 4.878% | o4-mini (high)Epoch AI benchmark runner | Epoch AI permanent refresh source ↗Observed 2026-06-11 · checked 2026-08-17source-checked · excluded |
| GPQA Diamond1.0.0 | 79.609% | o4-mini (high)Epoch AI benchmark runner | Epoch AI permanent refresh source ↗Observed 2025-04-16 · checked 2026-08-17source-checked · excluded |
| GPQA Diamond1.0.11 | 77.778% | o4-mini (medium)Epoch AI benchmark runner | Epoch AI permanent refresh source ↗Observed 2026-08-07 · checked 2026-08-17source-checked · excluded |
Specialist evidence
Source-native operational evidence for o4-mini. Exact configurations remain separate. Costs are comparable only within the same selected benchmark/evaluation, and these rows never enter Overall Score.
| Evaluation | Exact configuration | Performance | Cost / task | Tokens / task | Execution |
|---|---|---|---|---|---|
| SWE-bench Owner Leaderboards · owner-current · bash-only SWE-bench Owner Leaderboards · checked 2026-08-29 | o4-mini-default o4-mini (2025-04-16) | 45.0% | $0.210 | — | 23.3 calls |
| SWE-bench Owner Leaderboards · owner-current · multimodal SWE-bench Owner Leaderboards · checked 2026-08-29 | o4-mini-default GUIRepair + o4-mini (2025-04-16) | 33.9% | — | — | — |
| SWE-bench Owner Leaderboards · owner-current · verified SWE-bench Owner Leaderboards · checked 2026-08-29 | o4-mini-default mini-SWE-agent + o4-mini (2025-04-16) | 45.0% | $0.210 | — | 23.3 calls |
