The weights aren't deleted, it's just additional fine tuning, is my understanding.