And what happens once the "solid baselines" become unavailable for a reason or the other?

zozbot234 3 hours ago | parent | next [-]

You keep building on the last available version? Fine tuning is a whole lot cheaper, easier and more useful than pretraining a model from scratch. It's a complete no brainer.

	▲	rapidfl 2 hours ago \| parent [-]
		> You keep building on the last available version? yes but a sovereign can allocate some resources and a few people to stay in the loop from a first principles level. No need to wait for a rug pull. Of course, it can not compete with the frontier labs. But good to have researchers and professors "in-house". LLMs are here for the long-term.

▲

3 hours ago | parent | prev | next [-]

[deleted]

▲

ozim 3 hours ago | parent | prev [-]

Seems like you don’t understand.

You take current version and build on top of it. You have the weights.

You might not get some n+1 version at some point but the n version you will have will be still most likely much better than whatever you come up with burning good will money of people believing in „sovereignty”.

You are not getting ahead in this game by being „true to your local values” capital expenditure is insane in this game.