It's a weird article. Despite the title and some of the text, much of the article makes the point that LLMs are next-token predictors, where the predictions are based on both training data and various reinforcement learning techniques.

Obfuscation is the goal of the hype cycle in VC. Certain firms & individuals are minting money and that’s all that matters to them.

That there’s a legion of LLM nerds arguing deterministic this, pretraining & rewards that all the better for the con job they’re pulling off.

The technology will be relegated to the trash bin of history, just like crypto.