Remix.run Logo
▲ crimsoneer an hour ago

I think this is a quite optimistic view... releasing a SOTA model is a collosal capital investment, and unlike free software, it's not iterative - you can't make a small model and improve it one step at a time, you need to risk the whole load of cash, expertise and GPU time up front.

It's only happening now because labs have bucket tons of VC cash to burn and need a big public flex to raise more cash, or because they're subsidised by the Chinese government. I'm not massively confident either of those will stay true forever.

▲joelthelion 8 minutes ago | parent [-]

I'm not an expert, but maybe updating an existing open-weights model to give it up to date knowledge would be more tractable?