Both Opus 4.6 and GPT-5.3 one shot a Gameboy emulator for me. Guess I need a better benchmark.

well_ackshually an hour ago | parent | next [-]

There's hundreds of gameboy emulators available on Github they've been trained on. It's quite literally the simplest piece of emulation you could do. The fact that they couldn't do it before is an indictment of how shit they were, but a gameboy emulator should be a weekend project for anyone even ever so slightly qualified. Your benchmark was awful to begin with.

▲

gf000 39 minutes ago | parent | prev | next [-]

Is such an emulator not part of their training data sets?

▲

paxys 2 hours ago | parent | prev [-]

As coding agents get "good enough" the next differentiator will be which one can complete a task in fewer tokens.

	▲	tgtweak 2 hours ago \| parent \| next [-]
		Or quicker, or more comprehensively for the same price.
	▲	nlh 2 hours ago \| parent \| prev [-]
		Or the same number of tokens in less time. Kinda feels like the CPU / modem wars of the 90s all over again - I remember those differences you felt going from a 386 -> 486 or from a 2400 -> 9600 baud modem. We're in the 2400 baud era for coding agents and I for one look forward to the 56k era around the corner ;)