Remix.run Logo
Nevermark 6 days ago

Fine tuning with original data plus fine tuning data has more predictable results.

Just training on new data moves a model away from its previous behavior, to an unpredictably degree.

You can’t even reliably test for the change without the original data.