Wow, 30% on ARC-AGI-3 for $20k total. Huge jump from GPT-5.6's 7.8% at $20k per task. I continue to believe ARC-AGI measures something different and important compared to other benchmarks.

▲

oh_no 4 hours ago | parent | next [-]

seeing a jump this big is not a great sign for the continuing value of a benchmark

	▲	modeless 4 hours ago \| parent [-]
		It will continue to be valuable as a cost and speed benchmark long after it is saturated at the high end. And they are already working on ARC-AGI 4 and thinking about going even farther.

▲

dominotw 4 hours ago | parent | prev [-]

> I continue to believe ARC-AGI measures something different

why is that? its now being benchmaxxed too