If you could figure out exactly what certain weights do it would be way quicker to directly edit them, whereas training is non-deterministic and takes ages.

And the modifications of those weights could be tracked in source control and overlayed on top of the base model? I see, there is a lot of potential in that.