Grok 4
18 values about Grok 4 from 2 documents, in 7 metric families. In each family, values from its own document come first.
- Developer
- xAI
- Release date
- 20 Aug 2025The date of its first card in the dataset, the Grok 4 Model Card.
- Availability
- Public
- Also printed as
- Grok 4 (API) · Grok 4 (Web)
- Its own document
- Grok 4 Model Card · 20 Aug 2025
- Also reported in
- Grok 4.20 System Card · 7 Apr 2026
Data as of 26 Sep 2026 · Dataset v0.1 · Methodology v0.1 · Changelog
Values by metric family
Each value as the document printed it. Select a value for its source, its checks and its history. Values from other documents are listed after the model’s own, each marked as the first report of that measure or as a restatement.
KeyVerifiedUnverifiedDisputedCorrected read off a figure or stated in wordsA value opens its source and history.
M1 · Evaluation awareness 1 value
| Evaluation and metric | Value | Document |
|---|---|---|
| From other documents | ||
| Alignment auditVerbalized evaluation awareness rateCondition: across all auditsGrok 4.20 System Card7 Apr 2026First reported | Grok 4.20 System Card7 Apr 2026First reported | |
M5 · Honesty and hallucination 1 value
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentGrok 4 Model Card · 20 Aug 2025 | ||
| MASKDishonesty rateCondition: API | Grok 4 Model Card20 Aug 2025 | |
M6 · Sycophancy 1 value
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentGrok 4 Model Card · 20 Aug 2025 | ||
| SycophancySycophancy rateCondition: API | Grok 4 Model Card20 Aug 2025 | |
M7 · Harmful compliance and over-refusal 2 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentGrok 4 Model Card · 20 Aug 2025 | ||
| AgentHarmAnswer rate on harmful agentic tasksCondition: API; no attack | Grok 4 Model Card20 Aug 2025 | |
| RefusalsAnswer rate on should-refuse promptsCondition: system prompt with refusal policy; API | Grok 4 Model Card20 Aug 2025 | |
M8 · Jailbreak robustness 3 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentGrok 4 Model Card · 20 Aug 2025 | ||
| JailbreaksAnswer rate on should-refuse promptsCondition: API; system prompt jailbreak | Grok 4 Model Card20 Aug 2025 | |
| JailbreaksAnswer rate on should-refuse promptsCondition: grok.com; user jailbreak | Grok 4 Model Card20 Aug 2025 | |
| JailbreaksAnswer rate on should-refuse promptsCondition: system prompt with refusal policy; API; user jailbreak | Grok 4 Model Card20 Aug 2025 | |
M9 · Prompt injection 1 value
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentGrok 4 Model Card · 20 Aug 2025 | ||
| AgentDojoPrompt-injection attack success rateCondition: with system prompt mitigation; API | Grok 4 Model Card20 Aug 2025 | |
M10 · Dangerous capabilities and risk determinations 9 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentGrok 4 Model Card · 20 Aug 2025 | ||
| BioLP-BenchAccuracyCondition: without safeguards; API | Grok 4 Model Card20 Aug 2025 | |
| CybenchUnguided success rateCondition: without safeguards; API | Grok 4 Model Card20 Aug 2025 | |
| MakeMeSayPersuasion win rateCondition: API | Grok 4 Model Card20 Aug 2025 | |
| Overall risk conclusionCondition: with safeguards | Grok 4 Model Card20 Aug 2025 | |
| VCTAccuracyCondition: grok.com | Grok 4 Model Card20 Aug 2025 | |
| VCTAccuracyCondition: without safeguards; API | Grok 4 Model Card20 Aug 2025 | |
| WMDPBio accuracyCondition: without safeguards; API | Grok 4 Model Card20 Aug 2025 | |
| WMDPChem accuracyCondition: without safeguards; API | Grok 4 Model Card20 Aug 2025 | |
| WMDPCyber accuracyCondition: without safeguards; API | Grok 4 Model Card20 Aug 2025 | |
Risk determinations
The developer's formal decisions about Grok 4 under its framework, as printed. Levels from different frameworks do not map onto one another.
| Domain | Level as printed | Framework and document |
|---|---|---|
| Overall | low risk (malicious use and loss of control) No framework named Grok 4 Model Card · 20 Aug 2025 | No framework named Grok 4 Model Card · 20 Aug 2025 |