> LLMs are Markov Chains on steroids?

Might be a reference to this[1] blog post which was posted here[2] a year ago.

There has also been some academic work linking the two, like this[3] paper.

[1]: https://elijahpotter.dev/articles/markov_chains_are_the_orig...

[2]: https://news.ycombinator.com/item?id=39213410

[3]: https://arxiv.org/abs/2410.02724