Remix.run Logo
▲ bertonvv an hour ago

>The point isn't to make copying the model impossible, it's to make it computationally (or financially) infeasible.

The irony is that compute needs to get cheaper over time, for these companies to train the next bigger model and not go bankrupt. Their survival depends on distillation becoming more feasible over time.