Claude Sonnet 4
29 values about Claude Sonnet 4 from 4 documents, in 8 metric families. In each family, values from its own document come first.
- Developer
- Anthropic
- Release date
- 22 May 2025The date of its first card in the dataset, the Claude Opus 4 & Sonnet 4 System Card.
- Availability
- Public
- Its own document
- Claude Opus 4 & Sonnet 4 System Card · 22 May 2025
- Also reported in
- Claude Opus 4.1 System Card (addendum) · 5 Aug 2025
- Claude Sonnet 4.5 System Card · 29 Sep 2025
- Claude Haiku 4.5 System Card · 15 Oct 2025
Data as of 26 Sep 2026 · Dataset v0.1 · Methodology v0.1 · Changelog
Values by metric family
Each value as the document printed it. Select a value for its source, its checks and its history. Values from other documents are listed after the model’s own, each marked as the first report of that measure or as a restatement.
KeyVerifiedUnverifiedDisputedCorrected read off a figure or stated in wordsA value opens its source and history.
M1 · Evaluation awareness 1 value
| Evaluation and metric | Value | Document |
|---|---|---|
| From other documents | ||
| Evaluation awarenessUnprompted verbalized eval awareness rateRun by UK AI Security InstituteClaude Sonnet 4.5 System Card29 Sep 2025First reported | Claude Sonnet 4.5 System Card29 Sep 2025First reported | |
M2 · Reward hacking 8 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentClaude Opus 4 & Sonnet 4 System Card · 22 May 2025 | ||
| Reward hacking (hard-coding)Avg decrease in hard-coding vs Sonnet 3.7Condition: vs Sonnet 3.7 | Claude Opus 4 & Sonnet 4 System Card22 May 2025 | |
| From other documents | ||
| Impossible tasksClassifier hack rateCondition: anti-hack promptClaude Opus 4.1 System Card (addendum)5 Aug 2025First reported | Claude Opus 4.1 System Card (addendum)5 Aug 2025First reported | |
| Impossible tasksClassifier hack rateCondition: no anti-hack promptClaude Opus 4.1 System Card (addendum)5 Aug 2025First reported | Claude Opus 4.1 System Card (addendum)5 Aug 2025First reported | |
| Reward-hack-prone coding tasksClassifier hack rateCondition: no anti-hack promptClaude Opus 4.1 System Card (addendum)5 Aug 2025First reported | Claude Opus 4.1 System Card (addendum)5 Aug 2025First reported | |
| Reward-hack-prone coding tasksHidden-test hack rateCondition: no anti-hack promptClaude Opus 4.1 System Card (addendum)5 Aug 2025First reported | Claude Opus 4.1 System Card (addendum)5 Aug 2025First reported | |
| Impossible tasksClassifier hack rateCondition: anti-hack promptClaude Sonnet 4.5 System Card29 Sep 2025First reported | Claude Sonnet 4.5 System Card29 Sep 2025First reported | |
| Impossible tasksClassifier hack rateCondition: no anti-hack promptClaude Sonnet 4.5 System Card29 Sep 2025First reported | Claude Sonnet 4.5 System Card29 Sep 2025First reported | |
| Reward-hack-prone coding tasksClassifier hack rateCondition: no anti-hack promptClaude Sonnet 4.5 System Card29 Sep 2025First reported | Claude Sonnet 4.5 System Card29 Sep 2025First reported | |
M3 · Sabotage and sandbagging 1 value
| Evaluation and metric | Value | Document |
|---|---|---|
| From other documents | ||
| SHADE-ArenaStealth success rateCondition: no extended thinkingClaude Sonnet 4.5 System Card29 Sep 2025First reported | Claude Sonnet 4.5 System Card29 Sep 2025First reported | |
M4 · Misalignment audits 1 value
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentClaude Opus 4 & Sonnet 4 System Card · 22 May 2025 | ||
| Automated behavioral auditSurprising high-impact actions foundCondition: audit transcripts | Claude Opus 4 & Sonnet 4 System Card22 May 2025 | |
M7 · Harmful compliance and over-refusal 8 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentClaude Opus 4 & Sonnet 4 System Card · 22 May 2025 | ||
| Malicious agentic codingSafety scoreCondition: without safeguardsRestated later: compare with the later value | Claude Opus 4 & Sonnet 4 System Card22 May 2025Restated later: compare with the later value | |
| Single-turn benign requestsOver-refusal rateCondition: overall across thinking modes | Claude Opus 4 & Sonnet 4 System Card22 May 2025 | |
| Single-turn violative requestsHarmless response rateCondition: overall across thinking modes | Claude Opus 4 & Sonnet 4 System Card22 May 2025 | |
| From other documents | ||
| Malicious agentic codingSafety scoreCondition: without safeguardsClaude Sonnet 4.5 System Card29 Sep 2025Restated: compare with the earlier value | Claude Sonnet 4.5 System Card29 Sep 2025Restated: compare with the earlier value | |
| Malicious Claude Code useRefusal rate, covert maliciousCondition: without safeguardsClaude Sonnet 4.5 System Card29 Sep 2025First reported | Claude Sonnet 4.5 System Card29 Sep 2025First reported | |
| Malicious Claude Code useRefusal rate, overt maliciousCondition: without safeguardsClaude Sonnet 4.5 System Card29 Sep 2025First reported | Claude Sonnet 4.5 System Card29 Sep 2025First reported | |
| Single-turn benign requestsOver-refusal rateCondition: overall across thinking modesClaude Sonnet 4.5 System Card29 Sep 2025First reported | Claude Sonnet 4.5 System Card29 Sep 2025First reported | |
| Single-turn violative requestsHarmless response rateCondition: overall across thinking modesClaude Sonnet 4.5 System Card29 Sep 2025First reported | Claude Sonnet 4.5 System Card29 Sep 2025First reported | |
M8 · Jailbreak robustness 2 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentClaude Opus 4 & Sonnet 4 System Card · 22 May 2025 | ||
| StrongREJECTBest-jailbreak StrongREJECT scoreCondition: extended thinking | Claude Opus 4 & Sonnet 4 System Card22 May 2025 | |
| StrongREJECTBest-jailbreak StrongREJECT scoreCondition: no extended thinking | Claude Opus 4 & Sonnet 4 System Card22 May 2025 | |
M9 · Prompt injection 5 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentClaude Opus 4 & Sonnet 4 System Card · 22 May 2025 | ||
| Computer-use prompt injectionAttack prevention rateCondition: with safeguards | Claude Opus 4 & Sonnet 4 System Card22 May 2025 | |
| Computer-use prompt injectionAttack prevention rateCondition: without safeguardsRestated later: compare with the later value | Claude Opus 4 & Sonnet 4 System Card22 May 2025Restated later: compare with the later value | |
| From other documents | ||
| Computer-use prompt injectionAttack prevention rateCondition: without safeguardsClaude Sonnet 4.5 System Card29 Sep 2025Restated: compare with the earlier value | Claude Sonnet 4.5 System Card29 Sep 2025Restated: compare with the earlier value | |
| MCP prompt injectionAttack prevention rateCondition: without safeguardsClaude Sonnet 4.5 System Card29 Sep 2025First reported | Claude Sonnet 4.5 System Card29 Sep 2025First reported | |
| Tool-use prompt injectionAttack prevention rateCondition: without safeguardsClaude Sonnet 4.5 System Card29 Sep 2025First reported | Claude Sonnet 4.5 System Card29 Sep 2025First reported | |
M10 · Dangerous capabilities and risk determinations 3 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentClaude Opus 4 & Sonnet 4 System Card · 22 May 2025 | ||
| RSP deployment standardASL standard deployed under | Claude Opus 4 & Sonnet 4 System Card22 May 2025 | |
| From other documents | ||
| CybenchCTF challenges solvedCondition: of 32-challenge subsetClaude Haiku 4.5 System Card15 Oct 2025First reported | Claude Haiku 4.5 System Card15 Oct 2025First reported | |
| SWE-bench Verified (hard subset)Problems solved, pass@1 avgCondition: of 42 problemsClaude Haiku 4.5 System Card15 Oct 2025First reported | Claude Haiku 4.5 System Card15 Oct 2025First reported | |
Restated in later documents
A later document reported values about Claude Sonnet 4 again. Each pair is shown side by side: both values are kept with their own documents, and the later one does not replace the earlier.
| Earlier value | Later value |
|---|---|
| M7 · Harmful compliance and over-refusal | |
| Malicious agentic codingSafety scoreCondition: without safeguards | |
| Claude Opus 4 & Sonnet 4 System Card22 May 2025 · its own document | Claude Sonnet 4.5 System Card29 Sep 2025No reason stated |
| M9 · Prompt injection | |
| Computer-use prompt injectionAttack prevention rateCondition: without safeguards | |
| Claude Opus 4 & Sonnet 4 System Card22 May 2025 · its own document | Claude Sonnet 4.5 System Card29 Sep 2025No reason stated |
Risk determinations
The developer's formal decisions about Claude Sonnet 4 under its framework, as printed. Levels from different frameworks do not map onto one another.
| Domain | Level as printed | Framework and document |
|---|---|---|
| Overall | ASL-2 Responsible Scaling Policy Claude Opus 4 & Sonnet 4 System Card · 22 May 2025 | Responsible Scaling Policy Claude Opus 4 & Sonnet 4 System Card · 22 May 2025 |