Model profile / OpenAI

o3-mini

o3-mini is a proprietary model variant recorded in the BenchLM public dataset.

31 Jan 2025Closed weightsProvider

Sources & details

Four areas of evidence

The capabilities behind the model.

How the indices work

Reasoning

101.0Index points

Mathematical and scientific problem solving.

This model│ Other models · 155 rated

Score and research range

Full-precision point: 101.02044838474771
Range: 96.49–105.55 · 90% Research Range
Scope: R0 latent score conditional on frozen working model and native aggregate portfolio

Score uses the admitted direct native evidence under the selected method.

Coding

No current rating

Software engineering and programming.

Awaiting a qualified category score

General

No current rating

Factual reliability and instruction following.

Awaiting a qualified category score

Agentic

No current rating

Tool use, workflows and professional tasks.

Awaiting a qualified category score

11retained native records

9evidence families

Capabilities estimateQualified original evidence across four areas.

Current index snapshot · 2026-09-16. Each category uses its own scale; scores across categories are not directly comparable. Evidence counts describe the retained Capabilities inputs; a family can contain several tasks or configurations. A point lead does not establish superiority.

Performance in context

Capabilities, price & speed.

Explore every model

o3-mini is highlighted wherever a compatible measurement is available.

Lumina Capabilities Index

Capabilities versus API price

The current Capabilities cohort, with this model highlighted.

Lumina

2025+ · 62 models · 1 highlighted

Chart loads as you explore

Lumina Capabilities Index

Capabilities versus output speed

The current Capabilities cohort, with this model highlighted.

Lumina

2025+ · 72 models · Developer API · 10K · 1 highlighted

Chart loads as you explore

Explore the detail

Sources & model details.

Original evidence, with its context.

Current index evidence 2Scores, research ranges and the sources behind each category.

Capabilities

Score uses the admitted direct native evidence under the selected method.

Exact checkpoint: o3-mini
Method: methods-a4471cee84fd478d2ed3
Range interpretation: C1 native factor under conditional crossed source/family reweighting of admitted fixed-corpus reference and own portfolio
Sources: Artificial Analysis:Artificial Analysis · Epoch AI:Epoch AI
Source cutoff: {"asOfMeaning":"Selected local candidate: retained historical measurements plus reviewed additions; execution dates remain source-native.","newIdentityRecovery":"2026-09-13T08:41:08.804270+00:00","publicProjectionDate":"2026-09-16T06:02:45.491398+00:00","scoring":"Inherited pinned baseline source vintages plus retained4A/4A.1 originals and SWE owner correction; heterogeneous execution dates, often unknown. Not a claim of simultaneous2026-09-13 execution."}

Explore this index

Reasoning

Score uses the admitted direct native evidence under the selected method.

Exact checkpoint: o3-mini
Method: methods-a4471cee84fd478d2ed3
Range interpretation: R0 latent score conditional on frozen working model and native aggregate portfolio
Sources: aa · epoch
Source cutoff: {"asOfMeaning":"Selected local candidate: retained historical measurements plus reviewed additions; execution dates remain source-native.","newIdentityRecovery":"2026-09-13T08:41:08.804270+00:00","publicProjectionDate":"2026-09-16T06:02:45.491398+00:00","scoring":"Inherited pinned baseline source vintages plus retained4A/4A.1 originals and SWE owner correction; heterogeneous execution dates, often unknown. Not a claim of simultaneous2026-09-13 execution."}

Explore this index

Benchmark measurements 32Published values in each benchmark’s own units.

32 measurements

o3-mini published benchmark measurements
Benchmark	Result	Published configuration	Source
GPQA Diamond2026	74.8%	Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.Source-native system	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21source-checked · reference-only
GPQA Diamond2026	74.8%	Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.Source-native system	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27source-checked · reference-only
GPQA Diamond2026	74.8%	Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.Source-native system	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01source-checked · reference-only
Humanity's Last Exam2026	8.7%	Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.Source-native system	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21source-checked · reference-only
Humanity's Last Exam2026	8.7%	Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.Source-native system	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27source-checked · reference-only
Humanity's Last Exam2026	8.7%	Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.Source-native system	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01source-checked · reference-only
SciCode2026	39.9%	Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.Source-native system	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21source-checked · reference-only
SciCode2026	39.9%	Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.Source-native system	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27source-checked · reference-only
SciCode2026	39.9%	Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.Source-native system	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01source-checked · reference-only
American Invitational Mathematics Examination 20242024	87.3%	Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.Source-native system	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21source-checked · reference-only

Showing 10 of 32 measurements

Specifications & source recordsDocumented model details and original references.

Model ID / checkpoint: o3-mini
Weight access: Closed weights
Context window: 200,000
Maximum output: 100,000
Modalities: text
Details checked: 1 Aug 2026

Specialist task evidenceSeparate agent runs and execution conditions.

Specialist evidence

Agent runs and task economics

Source-native operational evidence for o3-mini. Exact configurations remain separate. Costs are comparable only within the same selected benchmark/evaluation, and these rows never enter Overall Score.

Specialist only · ranking prohibited

Evaluation	Exact configuration	Performance	Cost / task	Tokens / task	Execution
SWE-bench Owner Leaderboards · owner-current · lite SWE-bench Owner Leaderboards · checked 2026-08-29	o3-mini-default Agentless Lite + O3 Mini (20250214)	32.3%	—	—	—
SWE-bench Owner Leaderboards · owner-current · verified SWE-bench Owner Leaderboards · checked 2026-08-29	o3-mini-default Agentless Lite + O3 Mini (20250214)	42.4%	—	—	—

All models

Model profile / OpenAI

o3-mini

o3-mini is a proprietary model variant recorded in the BenchLM public dataset.

31 Jan 2025Closed weightsProvider

Sources & details

Four areas of evidence

The capabilities behind the model.

How the indices work

Reasoning

101.0Index points

Mathematical and scientific problem solving.

This model│ Other models · 155 rated

Score and research range

Full-precision point: 101.02044838474771
Range: 96.49–105.55 · 90% Research Range
Scope: R0 latent score conditional on frozen working model and native aggregate portfolio

Score uses the admitted direct native evidence under the selected method.

Coding

No current rating

Software engineering and programming.

Awaiting a qualified category score

General

No current rating

Factual reliability and instruction following.

Awaiting a qualified category score

Agentic

No current rating

Tool use, workflows and professional tasks.

Awaiting a qualified category score

11retained native records

9evidence families

Capabilities estimateQualified original evidence across four areas.

Performance in context

Capabilities, price & speed.

Explore every model

o3-mini is highlighted wherever a compatible measurement is available.

Lumina Capabilities Index

Capabilities versus API price

The current Capabilities cohort, with this model highlighted.

Lumina

2025+ · 62 models · 1 highlighted

Chart loads as you explore

Lumina Capabilities Index

Capabilities versus output speed

The current Capabilities cohort, with this model highlighted.

Lumina

2025+ · 72 models · Developer API · 10K · 1 highlighted

Chart loads as you explore

Explore the detail

Sources & model details.

Original evidence, with its context.

Current index evidence 2Scores, research ranges and the sources behind each category.

Capabilities

Score uses the admitted direct native evidence under the selected method.

Exact checkpoint: o3-mini
Method: methods-a4471cee84fd478d2ed3
Range interpretation: C1 native factor under conditional crossed source/family reweighting of admitted fixed-corpus reference and own portfolio
Sources: Artificial Analysis:Artificial Analysis · Epoch AI:Epoch AI
Source cutoff: {"asOfMeaning":"Selected local candidate: retained historical measurements plus reviewed additions; execution dates remain source-native.","newIdentityRecovery":"2026-09-13T08:41:08.804270+00:00","publicProjectionDate":"2026-09-16T06:02:45.491398+00:00","scoring":"Inherited pinned baseline source vintages plus retained4A/4A.1 originals and SWE owner correction; heterogeneous execution dates, often unknown. Not a claim of simultaneous2026-09-13 execution."}

Explore this index

Reasoning

Score uses the admitted direct native evidence under the selected method.

Exact checkpoint: o3-mini
Method: methods-a4471cee84fd478d2ed3
Range interpretation: R0 latent score conditional on frozen working model and native aggregate portfolio
Sources: aa · epoch
Source cutoff: {"asOfMeaning":"Selected local candidate: retained historical measurements plus reviewed additions; execution dates remain source-native.","newIdentityRecovery":"2026-09-13T08:41:08.804270+00:00","publicProjectionDate":"2026-09-16T06:02:45.491398+00:00","scoring":"Inherited pinned baseline source vintages plus retained4A/4A.1 originals and SWE owner correction; heterogeneous execution dates, often unknown. Not a claim of simultaneous2026-09-13 execution."}

Explore this index

Benchmark measurements 32Published values in each benchmark’s own units.

32 measurements

o3-mini published benchmark measurements
Benchmark	Result	Published configuration	Source
GPQA Diamond2026	74.8%	Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.Source-native system	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21source-checked · reference-only
GPQA Diamond2026	74.8%	Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.Source-native system	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27source-checked · reference-only
GPQA Diamond2026	74.8%	Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.Source-native system	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01source-checked · reference-only
Humanity's Last Exam2026	8.7%	Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.Source-native system	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21source-checked · reference-only
Humanity's Last Exam2026	8.7%	Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.Source-native system	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27source-checked · reference-only
Humanity's Last Exam2026	8.7%	Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.Source-native system	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01source-checked · reference-only
SciCode2026	39.9%	Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.Source-native system	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21source-checked · reference-only
SciCode2026	39.9%	Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.Source-native system	BenchLM public datasets — 2026-07-27 ↗Observed 2026-07-27 · checked 2026-07-27source-checked · reference-only
SciCode2026	39.9%	Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.Source-native system	BenchLM public datasets — 2026-08-01 ↗Observed 2026-08-01 · checked 2026-08-01source-checked · reference-only
American Invitational Mathematics Examination 20242024	87.3%	Exact BenchLM registry variant o3-mini; bulk export does not retain a complete upstream harness configuration.Source-native system	BenchLM public datasets — 21 July 2026 ↗Observed 2026-07-21 · checked 2026-07-21source-checked · reference-only

Showing 10 of 32 measurements

Specifications & source recordsDocumented model details and original references.

Model ID / checkpoint: o3-mini
Weight access: Closed weights
Context window: 200,000
Maximum output: 100,000
Modalities: text
Details checked: 1 Aug 2026

Specialist task evidenceSeparate agent runs and execution conditions.

Specialist evidence

Agent runs and task economics

Specialist only · ranking prohibited

Evaluation	Exact configuration	Performance	Cost / task	Tokens / task	Execution
SWE-bench Owner Leaderboards · owner-current · lite SWE-bench Owner Leaderboards · checked 2026-08-29	o3-mini-default Agentless Lite + O3 Mini (20250214)	32.3%	—	—	—
SWE-bench Owner Leaderboards · owner-current · verified SWE-bench Owner Leaderboards · checked 2026-08-29	o3-mini-default Agentless Lite + O3 Mini (20250214)	42.4%	—	—	—

The capabilities behind the model.

Capabilities, price & speed.

Capabilities versus API price

Capabilities versus output speed

Sources & model details.

Capabilities

Reasoning

Agent runs and task economics

More from OpenAI.

GPT-6 Astra

GPT-5.6 Sol

GPT-5.6 Terra

The capabilities behind the model.

Capabilities, price & speed.

Capabilities versus API price

Capabilities versus output speed

Sources & model details.

Capabilities

Reasoning

Agent runs and task economics

More from OpenAI.

GPT-6 Astra

GPT-5.6 Sol

GPT-5.6 Terra