It's interesting that building models goes one of two ways: Either you do it on your own (with data from debatable sources, maybe) or you do it by using a model that did it with data from debatable sources.

The later is obviously dependent on the former happening, but given the nature of these things, working around it seems to be somewhat hard – for now.

What happens, though, when frontier models become far less public? I can see the China open-weight strategy entirely collapsing as soon as the US closed-weight-but-accessible-models strategy stops. Hard to say how much they lean on it right now.