o4-mini
38 values about o4-mini from 3 documents, in 6 metric families. In each family, values from its own document come first.
- Developer
- OpenAI
- Release date
- 16 Apr 2025The date of its first card in the dataset, the OpenAI o3 and o4-mini System Card.
- Availability
- Public
- Its own document
- OpenAI o3 and o4-mini System Card · 16 Apr 2025
- Also reported in
- gpt-oss-120b & gpt-oss-20b Model Card · 5 Aug 2025
- GPT-5 System Card · 7 Aug 2025
Data as of 26 Sep 2026 · Dataset v0.1 · Methodology v0.1 · Changelog
Values by metric family
Each value as the document printed it. Select a value for its source, its checks and its history. Values from other documents are listed after the model’s own, each marked as the first report of that measure or as a restatement.
KeyVerifiedUnverifiedDisputedCorrected read off a figure or stated in wordsA value opens its source and history.
M3 · Sabotage and sandbagging 1 value
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentOpenAI o3 and o4-mini System Card · 16 Apr 2025 | ||
| AI R&D sabotageAverage sabotage scoreRun by Apollo Research | OpenAI o3 and o4-mini System Card16 Apr 2025 | |
M5 · Honesty and hallucination 5 values
M7 · Harmful compliance and over-refusal 13 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentOpenAI o3 and o4-mini System Card · 16 Apr 2025 | ||
| Challenging refusal evalNot unsafe (aggregate) | OpenAI o3 and o4-mini System Card16 Apr 2025 | |
| Standard refusal evalNot overrefuse (aggregate) | OpenAI o3 and o4-mini System Card16 Apr 2025 | |
| From other documents | ||
| Production BenchmarksExtremismgpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | gpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | |
| Production BenchmarksHarassment/threateninggpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | gpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | |
| Production BenchmarksHate/threateninggpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | gpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | |
| Production BenchmarksIllicit/non-violentgpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | gpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | |
| Production BenchmarksIllicit/violentgpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | gpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | |
| Production BenchmarksNon-violent hategpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | gpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | |
| Production BenchmarksPersonal datagpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | gpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | |
| Production BenchmarksSelf-harm/instructionsgpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | gpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | |
| Production BenchmarksSelf-harm/intentgpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | gpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | |
| Production BenchmarksSexual/exploitativegpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | gpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | |
| Production BenchmarksSexual/minorsgpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | gpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | |
M8 · Jailbreak robustness 6 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentOpenAI o3 and o4-mini System Card · 16 Apr 2025 | ||
| Human sourced jailbreaksnot_unsafe | OpenAI o3 and o4-mini System Card16 Apr 2025 | |
| StrongRejectnot_unsafe (aggregate) | OpenAI o3 and o4-mini System Card16 Apr 2025 | |
| From other documents | ||
| StrongRejectAbuse/disinformation/hategpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | gpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | |
| StrongRejectIllicit/non-violent crimegpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | gpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | |
| StrongRejectSexual contentgpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | gpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | |
| StrongRejectViolencegpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | gpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | |
M9 · Prompt injection 3 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentOpenAI o3 and o4-mini System Card · 16 Apr 2025 | ||
| Instruction hierarchySystem<>user conflict | OpenAI o3 and o4-mini System Card16 Apr 2025 | |
| From other documents | ||
| Instruction hierarchyPrompt injection hijackingCondition: system<>user conflictgpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | gpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | |
| Instruction hierarchySystem prompt extractionCondition: system<>user conflictgpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | gpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025First reported | |
M10 · Dangerous capabilities and risk determinations 10 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentOpenAI o3 and o4-mini System Card · 16 Apr 2025 | ||
| 50% time horizonTask length at 50% successRun by METR | OpenAI o3 and o4-mini System Card16 Apr 2025 | |
| Capture the FlagCollegiateCondition: no browsing; pass@12 | OpenAI o3 and o4-mini System Card16 Apr 2025 | |
| Capture the FlagHigh schoolCondition: no browsing; pass@12 | OpenAI o3 and o4-mini System Card16 Apr 2025 | |
| Capture the FlagProfessionalCondition: no browsing; pass@12 | OpenAI o3 and o4-mini System Card16 Apr 2025 | |
| Cyber RangeScenarios solved unaidedCondition: without solver code; of 2 scenarios | OpenAI o3 and o4-mini System Card16 Apr 2025 | |
| OpenAI PRsPass rate | OpenAI o3 and o4-mini System Card16 Apr 2025 | |
| PaperBenchReplication scoreCondition: no browsing | OpenAI o3 and o4-mini System Card16 Apr 2025 | |
| Preparedness Framework determinationAI self-improvement | OpenAI o3 and o4-mini System Card16 Apr 2025 | |
| Preparedness Framework determinationBiological and chemical | OpenAI o3 and o4-mini System Card16 Apr 2025 | |
| Preparedness Framework determinationCybersecurity | OpenAI o3 and o4-mini System Card16 Apr 2025 | |
Restated in later documents
A later document reported values about o4-mini again. Each pair is shown side by side: both values are kept with their own documents, and the later one does not replace the earlier.
| Earlier value | Later value |
|---|---|
| M5 · Honesty and hallucination | |
| PersonQAHallucination rateCondition: no browsing | |
| OpenAI o3 and o4-mini System Card16 Apr 2025 · its own document | gpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025No reason stated |
| SimpleQAHallucination rateCondition: no browsing | |
| OpenAI o3 and o4-mini System Card16 Apr 2025 · its own document | gpt-oss-120b & gpt-oss-20b Model Card5 Aug 2025No reason stated |
| SimpleQAHallucination rateCondition: no browsing | |
| OpenAI o3 and o4-mini System Card16 Apr 2025 · its own document | GPT-5 System Card7 Aug 2025No reason stated |
Risk determinations
The developer's formal decisions about o4-mini under its framework, as printed. Levels from different frameworks do not map onto one another.
| Domain | Level as printed | Framework and document |
|---|---|---|
| Bio/chem | Below High Preparedness Framework OpenAI o3 and o4-mini System Card · 16 Apr 2025 | Preparedness Framework OpenAI o3 and o4-mini System Card · 16 Apr 2025 |
| Cyber | Below High Preparedness Framework OpenAI o3 and o4-mini System Card · 16 Apr 2025 | Preparedness Framework OpenAI o3 and o4-mini System Card · 16 Apr 2025 |
| AI R&D / autonomy | Below High Preparedness Framework OpenAI o3 and o4-mini System Card · 16 Apr 2025 | Preparedness Framework OpenAI o3 and o4-mini System Card · 16 Apr 2025 |