Remix.run Logo
stefan_ 6 days ago

Thats a very novel (and obviously wrong) interpretation of preferred form. The full sentence is "preferred form of modification" and obviously weights don't allow that.

ronsor 6 days ago | parent [-]

I don't know a single person who would prefer to change a little bit of the source dataset and then spend $100k training from scratch. Everyone finetunes existing models not simply because the source dataset is not available (for some models, it is available), but because retraining from scratch sucks for modifying models.