An LLM is no more a fancy Markov Chain than you are. The math is well documented, go have a read.

About everything can be modelled with large enough Markov Chain, but I'd say stateless autoregressive models like LLMs are a lot easier analyzed as Markov Chains than recurrent systems with very complex internal states like humans.