> A markov chain of order N will only generate sequences of length N+1 that were in the training corpus

Depends on how you trained it, an LLM is also a markov chain.