Man, I had forgotten about this one.

Thanks for the highlight, I read Okazaki's the first time about 2014/15 IIRC.

Another great read is "A Theory of Regularity Structures" - https://arxiv.org/pdf/1303.5113. by Martin Hairer.

It builds on his thesis, Comportement Asymptotique d’ ´Equations `a D´eriv´ees Partielles Stochastiques. - https://www.hairer.org/papers/these.pdf

The English language preprint from just prior to the French is at https://arxiv.org/pdf/math/0109115 "Exponential Mixing Properties of Stochastic PDEs Through Asymptotic Coupling" great, but I read them in revers order from publication and kind of prefer them in that order.

I cant disagree with the premise of the OC, however, there's a feel to Hairer's and Okasaki's insights and presentation that simply is not going to be reached via the lossy compression that is at the heart of LLM.

If that sets a high bar for who gets a PhD going forward, this would be a good thing.