I would say that it is not even wrong. You say it’s a next token predictor. I say it isn’t. What observable behavior of the system can settle our dispute?

I fail to see how any possible output could cause either of us to change our mind.

That's perfectly put. The value of words and what we assign to them, let alone how we assign meaning, or the interpretation of what the other person says, is completely arbitrary. (in practice).

What comes after “the dog”?

Does it complete the sentence?

If not then it’s not a next token predictor. Or at least not a good one.