Maybe LLMs can solve novel problems, maybe not. We don't know for sure. It's trending like it can.

There are still plenty of problems that having more tokens would allow them to be solved, and solved faster, better. There is no absolutely no way we've already met AI compute demands for the problems that LLMs can solve today.

There is zero evidence that LLMs can do anything novel without a human in the loop. At most LLM is a hammer. Not exactly useless by any stretch of the imagination, but yes you need a human to swing it.

Every solution generated by an AI for a novel problem was ultimately rescinded. There is no trend, there is only hope.