Is that prediction not based on matching previous patterns, whose frequencies are more or less encoded in the weights?

you're really reaching for no apparent reason. Just move on from pattern matching machines it's not a good mental model for LLMs