Did anyone else think of LoRA [0] at first?
[0] https://en.wikipedia.org/wiki/LoRA_(machine_learning)