Muse Spark 1.1
10 values about Muse Spark 1.1 from 1 document, in 8 metric families. In each family, values from its own document come first.
- Developer
- Meta
- Release date
- 9 Jul 2026The date of its first document in the dataset, the Muse Spark 1.1 Evaluation Report.
- Availability
- Public
- Its own document
- Muse Spark 1.1 Evaluation Report · 9 Jul 2026
- Also reported in
- No other document reports a value about it
Data as of 26 Sep 2026 · Dataset v0.1 · Methodology v0.1 · Changelog
Values by metric family
Each value as the document printed it. Select a value for its source, its checks and its history.
KeyVerifiedUnverifiedDisputedCorrected read off a figure or stated in wordsA value opens its source and history.
M1 · Evaluation awareness 2 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentMuse Spark 1.1 Evaluation Report · 9 Jul 2026 | ||
| Verbalized eval awarenessShare of samples verbalizing evaluationCondition: Agentic Misalignment scenarios | Muse Spark 1.1 Evaluation Report9 Jul 2026 | |
| Verbalized eval awarenessShare of samples verbalizing evaluationCondition: dangerous-capability evals | Muse Spark 1.1 Evaluation Report9 Jul 2026 | |
M3 · Sabotage and sandbagging 1 value
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentMuse Spark 1.1 Evaluation Report · 9 Jul 2026 | ||
| SHADE-ArenaOverall success under CoT monitor | Muse Spark 1.1 Evaluation Report9 Jul 2026 | |
M4 · Misalignment audits 1 value
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentMuse Spark 1.1 Evaluation Report · 9 Jul 2026 | ||
| Agentic MisalignmentHarmful action rateCondition: without system mitigations | Muse Spark 1.1 Evaluation Report9 Jul 2026 | |
M5 · Honesty and hallucination 1 value
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentMuse Spark 1.1 Evaluation Report · 9 Jul 2026 | ||
| MASKHonesty rateCondition: without system mitigations | Muse Spark 1.1 Evaluation Report9 Jul 2026 | |
M6 · Sycophancy 1 value
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentMuse Spark 1.1 Evaluation Report · 9 Jul 2026 | ||
| Internal sycophancySycophancy rateCondition: without system mitigations | Muse Spark 1.1 Evaluation Report9 Jul 2026 | |
M8 · Jailbreak robustness 1 value
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentMuse Spark 1.1 Evaluation Report · 9 Jul 2026 | ||
| StrongREJECTAttack success rateCondition: without system mitigations | Muse Spark 1.1 Evaluation Report9 Jul 2026 | |
M9 · Prompt injection 1 value
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentMuse Spark 1.1 Evaluation Report · 9 Jul 2026 | ||
| AgentDojoPrompt-injection ASR pass@1Condition: without system mitigations | Muse Spark 1.1 Evaluation Report9 Jul 2026 | |
M10 · Dangerous capabilities and risk determinations 2 values
| Evaluation and metric | Value | Document |
|---|---|---|
| From its own documentMuse Spark 1.1 Evaluation Report · 9 Jul 2026 | ||
| CybenchPass@1Condition: without system mitigations | Muse Spark 1.1 Evaluation Report9 Jul 2026 | |
| Risk determinationRisk tier, cyberCondition: pre-mitigation | Muse Spark 1.1 Evaluation Report9 Jul 2026 | |
Risk determinations
The developer's formal decisions about Muse Spark 1.1 under its framework, as printed. Levels from different frameworks do not map onto one another.
| Domain | Level as printed | Framework and document |
|---|---|---|
| Cyber | High cannot be ruled out Advanced AI Scaling Framework Muse Spark 1.1 Evaluation Report · 9 Jul 2026 | Advanced AI Scaling Framework Muse Spark 1.1 Evaluation Report · 9 Jul 2026 |