Because people already tried to get LLMs to solve ARC-AGI puzzles by training on millions of similar puzzles, and it doesn’t work.

Some problems fundamentally require many serial steps to solve. Reasoning LLMs can work through those steps, base LLMs can’t.