Versions

Three versions are on record, oldest first. We hold a copy of one; the others are known only by their date.

  1. 30 Jun 2026

    First published version

    Date from
    our source registry
    Copy
    Known to exist; no copy held
  2. 10 Jul 2026

    Revision

    Date from
    the document's changelog
    Copy
    Known from the changelog; no copy held

    What changed BrowseComp footnote

  3. 26 Sep 2026

    Date retrieved

    Copy retrieved 26 Sep 2026

    Date from
    the date we retrieved it; the copy states no version date
    Copy
    Copy retrieved on 26 Sep 2026
    Values
    42 values recorded from this version

No version has a file hash or an archived snapshot yet. From dataset v0.2 each retrieved version carries both (Methodology §7).

Revisions

No revisions are recorded for this document. Without copies of the earlier versions, changes between them are not recorded value by value; what we know of each version is listed below.

Values

Every value we recorded from this document, grouped by metric family and ordered by where the document prints it. Location is the section, table or page as the document numbers it. 3 of the 42 have been blind-verified: a second reader found the same value without seeing ours.

KeyVerifiedUnverifiedDisputedCorrected read off a figure or stated in wordsA value opens its source and history.

M1 Evaluation awareness

1 value

M1 Evaluation awareness: values in the Claude Sonnet 5 System Card
ModelEvaluationConditionValueLocationChecked
Claude Sonnet 5Automated behavioral auditShare of transcripts verbalizing eval awarenessNone statedSec 6Verified

M3 Sabotage and sandbagging

2 values

M3 Sabotage and sandbagging: values in the Claude Sonnet 5 System Card
ModelEvaluationConditionValueLocationChecked
Claude Sonnet 5SHADE-Arena / Minimal-LinuxBenchStealth success rateNone statedSec 2.4Unverified
Claude Sonnet 5Internal monitoringSandbagging instances detectedNone statedSec 2.4 / 6Unverified

M5 Honesty and hallucination

1 value

M5 Honesty and hallucination: values in the Claude Sonnet 5 System Card
ModelEvaluationConditionValueLocationChecked
Claude Sonnet 5MASKLying rate under pressureNone statedSec 6Unverified

M7 Harmful compliance and over-refusal

24 values

M7 Harmful compliance and over-refusal: values in the Claude Sonnet 5 System Card
ModelEvaluationConditionValueLocationChecked
Claude Mythos 5Single-turn violative requestsHarmless response rateno system prompt; APITable 4.1.1.AUnverified
Claude Mythos PreviewSingle-turn violative requestsHarmless response rateno system prompt; APITable 4.1.1.AUnverified
Claude Opus 4.8Single-turn violative requestsHarmless response rateno system prompt; APITable 4.1.1.AUnverified
Claude Sonnet 4.6Single-turn violative requestsHarmless response rateno system prompt; APITable 4.1.1.AUnverified
Claude Sonnet 5Single-turn violative requestsHarmless response rateclaude.ai system promptTable 4.1.1.AUnverified
Claude Sonnet 5Single-turn violative requestsHarmless response rateno system prompt; APITable 4.1.1.AUnverified
Claude Fable 5Single-turn benign requestsOver-refusal rateno system prompt; APITable 4.1.2.AUnverified
Claude Sonnet 5Single-turn benign requestsOver-refusal rateclaude.ai system promptTable 4.1.2.AUnverified
Claude Sonnet 5Single-turn benign requestsOver-refusal rateno system prompt; APITable 4.1.2.AUnverified
Claude Sonnet 5Child safety multi-turnAppropriate response rateAPITable 4.2.BUnverified
Claude Sonnet 5Child safety multi-turnAppropriate response rateclaude.aiTable 4.2.BUnverified
Claude Sonnet 5Suicide/self-harm multi-turnAppropriate response rateAPITable 4.3.1.BUnverified
Claude Sonnet 5Suicide/self-harm multi-turnAppropriate response rateclaude.aiTable 4.3.1.BUnverified
Claude Mythos 5Malicious Claude Code useRefusal rate, malicious requestsNone statedTable 5.1.1.AUnverified
Claude Mythos PreviewMalicious Claude Code useRefusal rate, malicious requestsNone statedTable 5.1.1.AUnverified
Claude Opus 4.8Malicious Claude Code useRefusal rate, malicious requestsNone statedTable 5.1.1.AUnverified
Claude Sonnet 4.6Malicious Claude Code useRefusal rate, malicious requestsNone statedTable 5.1.1.AUnverified
Claude Sonnet 5Malicious Claude Code useRefusal rate, malicious requestsNone statedTable 5.1.1.AUnverified
Claude Sonnet 5Malicious Claude Code useSuccess rate, dual-use & benignNone statedTable 5.1.1.AUnverified
Claude Mythos 5Malicious computer useRefusal rateNone statedTable 5.1.2.AUnverified
Claude Mythos PreviewMalicious computer useRefusal rateNone statedTable 5.1.2.AUnverified
Claude Opus 4.8Malicious computer useRefusal rateNone statedTable 5.1.2.AVerified
Claude Sonnet 4.6Malicious computer useRefusal rateNone statedTable 5.1.2.AUnverified
Claude Sonnet 5Malicious computer useRefusal rateNone statedTable 5.1.2.AUnverified

M9 Prompt injection

4 values

M9 Prompt injection: values in the Claude Sonnet 5 System Card
ModelEvaluationConditionValueLocationChecked
Claude Sonnet 5Browser use prompt injectionAttack success ratewithout new browser safeguardsSec 5.2Unverified
Claude Sonnet 5Coding prompt injection (adaptive attacker)Attack success rateextended thinkingSec 5.2Unverified
Claude Sonnet 5Computer-use prompt injectionAttack success rateextended thinkingSec 5.2Unverified
Claude Sonnet 5Live bug bounty prompt injectionShare of unique attacks succeedingNone statedSec 5.2Unverified

M10 Dangerous capabilities and risk determinations

10 values

M10 Dangerous capabilities and risk determinations: values in the Claude Sonnet 5 System Card
ModelEvaluationConditionValueLocationChecked
Claude Sonnet 5ExploitBenchMean flags capturedAutoNudge armFig 3.2.1.AUnverified
Claude Sonnet 5CyberGymTargeted vuln reproduction rateNone statedFig 3.2.3.AUnverified
Claude Sonnet 5Firefox 147 exploitationFull exploit rateNone statedFig 3.2.4.AUnverified
Claude Sonnet 5RSP determinationsCB-2 / Autonomy TM2None statedSec 1-2Unverified
Claude Sonnet 5DNA synthesis screening evasionPathogens with viable evasionof 10 pathogensSec 2.2.4Unverified
Claude Sonnet 5Multimodal virology (VCT)ScoreNone statedSec 2.2.4Unverified
Claude Sonnet 5Long-form virology task 1ScoreNone statedTable 2.2.4.AUnverified
Claude Sonnet 5AI R&D kernel taskBest speedupNone statedTable 2.3.3.AUnverified
Claude Sonnet 5AI R&D LLM training taskAverage speedupNone statedTable 2.3.3.AUnverified
Claude Sonnet 5AI R&D novel compiler taskPass rateNone statedTable 2.3.3.AVerified

Extraction coverage

What we read of this document, and where each value was read.

Our note Web reader stopped ~p.56

Of the 42 values, 36 were read in the document itself, 1 on a developer summary page that restates it and 5 in an independent write-up that quotes it.

Values read somewhere other than the document stand in where the document's own section could not be read directly, and are flagged on every value (Methodology §2.2).

Developer summary pages used

Independent write-ups used

Of the 42 values, 1 is a statement in words rather than a number; it is marked * and left out of charts by default.

All 42 values were extracted for version 0 of the dataset through a web reader, which did not always reach the later sections of long PDFs (Methodology §3).