I didn't know model merging like that was possible. (Obviously possible from a pure software standpoint but I'm surprised it's effective)

As another poster above linked, it’s been shown to be effective since 2022: https://arxiv.org/abs/2203.05482