Remix.run Logo
willy_k 5 hours ago

Because deleting model weights after training is likely to cause knock-on effects in model knowledge and/or behavior. Targetting it might mitigate this but it’s

a) not guaranteed that only censor-ey parameters get removed, and b) likely that removing those parameters still has effects on the effectiveness of related parameters.

jszymborski 4 hours ago | parent [-]

The weights aren't deleted, it's just additional fine tuning, is my understanding.