Remix clone Hacker News

new | show | ask | jobs Github

▲

thefourthchime 3 hours ago

Why does your benchmark have Opus 5 scoring the highest?

▲

wolttam 2 hours ago | parent [-]

Because Opus 5 is the best at their benchmark.

▲

dom96 2 hours ago | parent [-]

yeah, it performed best for whatever reason. More specifically, it managed to deduce the meaning of the hack statement in the language better than Opus 5.5 did.

▲

epolanski an hour ago | parent [-]

How many runs you make for each model?

Do you report an average score or the highest.

	▲	dom96 32 minutes ago \| parent [-]
		2 runs for each task, for each task it's either a pass/fail (the small green/red dots show each task pass/fail)