| ▲ | abixb 5 hours ago | |
>When we released ARC 3, I got asked, "when do you think a frontier model will saturate it?", and I answered "in about a year, though it depends on how much it gets explicitly targeted" You're treating an off-hand comment by an ARC 3 researcher as some sort of a precise AI capability acceleration benchmark. Can we leave casual anecdotes (even from researchers) out of the discussions please? | ||
| ▲ | z7 3 hours ago | parent [-] | |
François Chollet wrote in February that he expected ARC-3 to be saturated in "about one year". "Frontier models today perform very poorly with a minimal harness. However if big labs start directly targeting the benchmark like they did for ARC-2, numbers will go up fast." | ||