Medium vs High? Why? From all the charts I've seen the performance jump is pretty large from med -> high (not as noticeable from high -> xhigh).

Medium or low supposedly prevents Opus 5 from overthinking:

sothatsit 3 hours ago | parent | prev | next [-]

If I need something smarter I use Fable. Medium works well and is quick. Opus 5 medium feels much better to me than Opus 4.8 medium.

	▲	dhorthy 3 hours ago \| parent [-]
		yeah someone will have to re-run this bench on various effort levels. unfortunately it is not cheap

Quality vs cost - medium is the sweet (perhaps better too!) spot.

	▲	dhorthy 2 hours ago \| parent [-]
		my issue with frontier code is that it uses a model judge for quality whereas slop code bench forces a model to grapple with its own garbage code in order to receive a functionality reward