Remix.run Logo
▲ delillos 5 hours ago

Those version numbers don't necessarily correspond to equal increases in "difficulty", though.

▲password54321 5 hours ago | parent | next [-]

Correct, the benchmark became exponentially more difficult as it progressed from pattern matching puzzles to games.

▲JacobAsmuth 4 hours ago | parent | prev [-]

Very true, the sharp increase in difficulty (as measured by human passrate plummeting from 1->2 and again from 2->3) gives an even more stark view of AI capabilities over time.