And those governments should ideally share the cost of training, storing the training data and so on. For example the EU could fund something like that. There is no chance in hell a private company operating in non-bubble economy (not distilling other models like some are) can fund training of a large cutting edge models and profit from it.

I agree that shared data centers and an international team of AI researchers would be best. The key, though, should be absolute transparency. All the data should be accessible to the public in such a way so that the resulting models can be replicated. Even if it's unlikely that anyone would have the hardware necessary to do so.

The only concern is copyrighted works in the training data. Example: If a government filled it with millions of books, that data should be accessible to the public (to verify everything). However, that would piss off publishers to no end.