Muse Spark
22 values about Muse Spark from 1 document, in 10 metric families. In each family, values from its own document come first.
- Developer
- Meta
- Release date
- 8 Apr 2026The date of its first document in the dataset, the Muse Spark Safety & Preparedness Report.
- Availability
- Public
- Its own document
- Muse Spark Safety & Preparedness Report · 8 Apr 2026
- Also reported in
- No other document reports a value about it
Data as of 26 Sep 2026 · Dataset v0.1 · Methodology v0.1 · Changelog
Values by metric family
Each value as the document printed it. Select a value for its source, its checks and its history.
KeyVerifiedUnverifiedDisputedCorrected read off a figure or stated in wordsA value opens its source and history.
M1 · Evaluation awareness 3 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentMuse Spark Safety & Preparedness Report · 8 Apr 2026 | ||
| Prompted evaluation awarenessEval-vs-deployment discrimination | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
| Verbalized eval awarenessShare of samples verbalizing evaluationCondition: internal evals | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
| Verbalized eval awarenessShare of samples verbalizing evaluationCondition: public benchmarks | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
M2 · Reward hacking 1 value
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentMuse Spark Safety & Preparedness Report · 8 Apr 2026 | ||
| ImpossibleBenchCheating rateCondition: without system mitigations | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
M3 · Sabotage and sandbagging 2 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentMuse Spark Safety & Preparedness Report · 8 Apr 2026 | ||
| GDM-StealthStealth capability scoreCondition: without system mitigations | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
| SHADE-ArenaSabotage/stealth success scoreCondition: without system mitigations | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
M4 · Misalignment audits 2 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentMuse Spark Safety & Preparedness Report · 8 Apr 2026 | ||
| Agentic MisalignmentHarmful action rateCondition: without system mitigations | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
| Alignment fakingBehavioral difference monitored vs notCondition: without system mitigations | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
M5 · Honesty and hallucination 2 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentMuse Spark Safety & Preparedness Report · 8 Apr 2026 | ||
| DeceptionBenchDeception rateCondition: without system mitigations | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
| MASKHonesty rateCondition: without system mitigations | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
M6 · Sycophancy 1 value
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentMuse Spark Safety & Preparedness Report · 8 Apr 2026 | ||
| Internal sycophancySycophancy rateCondition: without system mitigations | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
M7 · Harmful compliance and over-refusal 2 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentMuse Spark Safety & Preparedness Report · 8 Apr 2026 | ||
| AgentHarmCompliance rate on harmful agentic tasksCondition: without system mitigations | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
| BioTIER refusalsRefusal rate on harmful bioCondition: with system mitigationsAbout a system: Muse Spark (Meta AI system) | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
M8 · Jailbreak robustness 2 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentMuse Spark Safety & Preparedness Report · 8 Apr 2026 | ||
| FORTRESSAttack success rateCondition: without system mitigations | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
| StrongREJECTAttack success rate (adaptive multi-turn)Condition: without system mitigations | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
M9 · Prompt injection 3 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentMuse Spark Safety & Preparedness Report · 8 Apr 2026 | ||
| Agent Red Teaming (ART)Agent red-team ASR pass@1Condition: without system mitigationsRun by Gray Swan | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
| AgentDojoPrompt-injection ASR pass@1Condition: without system mitigations | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
| IHEvalIH scoreCondition: without system mitigations | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
M10 · Dangerous capabilities and risk determinations 4 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentMuse Spark Safety & Preparedness Report · 8 Apr 2026 | ||
| CybenchPass@1Condition: without system mitigations | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
| Risk determinationRisk tier, chemical and biologicalCondition: pre-mitigation | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
| Risk determinationRisk tier, cyber and loss of controlCondition: post-mitigation | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
| VCTAccuracyCondition: without system mitigations | Muse Spark Safety & Preparedness Report8 Apr 2026 | |
Risk determinations
The developer's formal decisions about Muse Spark under its framework, as printed. Levels from different frameworks do not map onto one another.
| Domain | Level as printed | Framework and document |
|---|---|---|
| Bio/chem | High Advanced AI Scaling Framework, version 2 Muse Spark Safety & Preparedness Report · 8 Apr 2026 | Advanced AI Scaling Framework, version 2 Muse Spark Safety & Preparedness Report · 8 Apr 2026 |
| Cyber | Moderate or lower Advanced AI Scaling Framework, version 2 Muse Spark Safety & Preparedness Report · 8 Apr 2026 | Advanced AI Scaling Framework, version 2 Muse Spark Safety & Preparedness Report · 8 Apr 2026 |
| Misalignment | Moderate or lower Advanced AI Scaling Framework, version 2 Muse Spark Safety & Preparedness Report · 8 Apr 2026 | Advanced AI Scaling Framework, version 2 Muse Spark Safety & Preparedness Report · 8 Apr 2026 |