Francois Chollet accuses the big labs of targeting the benchmark, yes. It is benchmaxxed.

tasuki 2 hours ago | parent | next [-]

Didn't the same Francois Chollet claim that this was the Real Test of Intelligence? If they target it, perhaps they target... real intelligence?

I don't know what he could mean by that, as the whole idea behind ARC-AGI is to "target the benchmark." Got any links that explain further?

	▲	layer8 2 hours ago \| parent [-]
		The fact that ARC-AGI has public and semi-private in addition to private datasets might explain it: https://arcprize.org/arc-agi/2/#dataset-structure