Remix.run Logo
▲ password54321 5 hours ago

It took 6 years to solve ARC-AGI 1, 1 year to solve ARC-AGI 2 and 6 months to solve ARC-AGI 3.

▲delillos 5 hours ago | parent [-]

Those version numbers don't necessarily correspond to equal increases in "difficulty", though.

▲password54321 5 hours ago | parent | next [-]

Correct, the benchmark became exponentially more difficult as it progressed from pattern matching puzzles to games.

▲JacobAsmuth 4 hours ago | parent | prev [-]

Very true, the sharp increase in difficulty (as measured by human passrate plummeting from 1->2 and again from 2->3) gives an even more stark view of AI capabilities over time.