I could never get used to that. I should probably try forcing the issue to see if I can rewire my muscle memory, but I'm afraid that it'll be a problem in places where I don't want caps lock rebound to ctrl.

I've made it a second ctrl decades ago... you so rarely need caps lock (unless you're shouting on the internet) that it's a gain rather than a loss. Your pinky can rest much more comfortably on the key and you don't have to twist your joint to reach CTRL.

Give it another try.