You keep building on the last available version? Fine tuning is a whole lot cheaper, easier and more useful than pretraining a model from scratch. It's a complete no brainer.

> You keep building on the last available version?

yes but a sovereign can allocate some resources and a few people to stay in the loop from a first principles level. No need to wait for a rug pull.

Of course, it can not compete with the frontier labs. But good to have researchers and professors "in-house". LLMs are here for the long-term.