Why do people have such faith in "open source" models? There's nothing "open source" about them. No individuals have the ability to train such modules. They are just released by companies to commoditize the models of the competition.

If Mythos is the endgame, companies won't release open-weight equivalents, and no private individuals have the capital to train such models.

> There's nothing "open source" about them. No individuals have the ability to train such modules.

I expect that people on subscriptions can be asked to donate 1 query a month towards an open source distillery.

It should be good enough to distill SOTA models over time.

The result won't be perfect, but it will be close.

Think SETI@home, but it'll be model distillation instead.

The open models cannot be taken away. Anyone with the right hardware can host these. Unlike the API/subscription services where you can be banned from, may have drastic price increases or reduction of their limits.