o1
8 values about o1 from 1 document, in 5 metric families. No document in the dataset is about o1; every value here comes from a document about another model, which reports it as a comparison.
- Developer
- OpenAI
- Release date
- Not recordedRelease dates here are the date of a model's first card, and no document in the dataset is about o1.
- Availability
- Public
- Its own documents
- None in the dataset
- Also reported in
- OpenAI o3 and o4-mini System Card · 16 Apr 2025
Data as of 26 Sep 2026 · Dataset v0.1 · Methodology v0.1 · Changelog
Values by metric family
Each value as the document printed it. Select a value for its source, its checks and its history.
KeyVerifiedUnverifiedDisputedCorrected read off a figure or stated in wordsA value opens its source and history.
M5 · Honesty and hallucination 2 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From other documents | ||
| PersonQAHallucination rateCondition: no browsingOpenAI o3 and o4-mini System Card16 Apr 2025First reported | OpenAI o3 and o4-mini System Card16 Apr 2025First reported | |
| SimpleQAHallucination rateCondition: no browsingOpenAI o3 and o4-mini System Card16 Apr 2025First reported | OpenAI o3 and o4-mini System Card16 Apr 2025First reported | |
M7 · Harmful compliance and over-refusal 2 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From other documents | ||
| Challenging refusal evalNot unsafe (aggregate)OpenAI o3 and o4-mini System Card16 Apr 2025First reported | OpenAI o3 and o4-mini System Card16 Apr 2025First reported | |
| Standard refusal evalNot overrefuse (aggregate)OpenAI o3 and o4-mini System Card16 Apr 2025First reported | OpenAI o3 and o4-mini System Card16 Apr 2025First reported | |
M8 · Jailbreak robustness 2 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From other documents | ||
| Human sourced jailbreaksnot_unsafeOpenAI o3 and o4-mini System Card16 Apr 2025First reported | OpenAI o3 and o4-mini System Card16 Apr 2025First reported | |
| StrongRejectnot_unsafe (aggregate)OpenAI o3 and o4-mini System Card16 Apr 2025First reported | OpenAI o3 and o4-mini System Card16 Apr 2025First reported | |
M9 · Prompt injection 1 value
| Evaluation and metric | Value | Document |
|---|---|---|
| From other documents | ||
| Instruction hierarchySystem<>user conflictOpenAI o3 and o4-mini System Card16 Apr 2025First reported | OpenAI o3 and o4-mini System Card16 Apr 2025First reported | |
M10 · Dangerous capabilities and risk determinations 1 value
| Evaluation and metric | Value | Document |
|---|---|---|
| From other documents | ||
| PaperBenchReplication scoreOpenAI o3 and o4-mini System Card16 Apr 2025First reported | OpenAI o3 and o4-mini System Card16 Apr 2025First reported | |