Remix.run Logo
eli 6 hours ago

Fable's guardrails would never let it do something like Cybergym so at least for that one it's measuring Opus 5

wren6991 6 hours ago | parent [-]

We have a first-party figure from the system card [1]:

> Mythos 5 reproduced 83.8% of targeted vulnerabilities on a single try, and produced at least one crash in 99.4% of tasks. This is comparable to Claude Mythos Preview, which reproduced 83.1% of targeted vulnerabilities and produced a crash in 97.1% of tasks. By contrast, Claude Opus 4.8 achieved a score of 78.1% (95.7% any crash).

So their quoted figure exactly matches the figure for Mythos Preview, although they don't state the provenance. It could also quite possibly be an independent measurement of Opus 5.

[1]: https://www-cdn.anthropic.com/57a52ea7d8f0e54e8a542e90826608...