Ran it on my adversarial programming language (KillSwitch) benchmark[1]. Very significant improvement over K3. On par with Gemini 4 Argon and Fable 5.1. Much slower than both though.

But this is now the highest scoring open-weight model. Amazing stuff.

1 - https://bench.killswitch-lang.org

▲

thefourthchime 2 hours ago | parent [-]

Why does your benchmark have Opus 5 scoring the highest?

▲

wolttam an hour ago | parent [-]

Because Opus 5 is the best at their benchmark.

▲

dom96 an hour ago | parent [-]

yeah, it performed best for whatever reason. More specifically, it managed to deduce the meaning of the hack statement in the language better than Opus 5.5 did.

	▲	epolanski 27 minutes ago \| parent [-]
		How many runs you make for each model? Do you report an average score or the highest.