Came directly to comments hoping not to see this one.

<sad trombone sound>

Surely someone will soon do what the title of this post makes it seem like cloudfare did. Truly modular open source training and inference logic, along with a totally open corpus and weights, will eventually out-compete the closed ecosystem.

There are some groups doing it for LLMs - like the Allen Institute for AI's Olmo models and Eluether AI's Pythia.