This is utter nonsense.

There's a formal equivalence between Markov chains and literally any system. The entire world can be viewed as a Markov chain. This doesn't tell you anything of interest, just that if you expand state without bound you eventually get the Markov property.

Why can't an LLM do backtracking? Not only within its multiple layers but across token models as reasoning models already do.

You are a probabilistic generative model (If you object, all of quantum mechanics is). I guess that means you can't do any reasoning!