What does omniscience have to do with reasoning? If you know everything, you don’t have to reason. But these next-word-predictors aren’t omniscient.

Omniscience doesn’t imply that you have to store all the information, but that you can retrieve/reconstruct it, and reasoning allows it.