▲ | Nevermark 6 days ago | |
Fine tuning with original data plus fine tuning data has more predictable results. Just training on new data moves a model away from its previous behavior, to an unpredictably degree. You can’t even reliably test for the change without the original data. |