I’ve made the compromise of using nix package manager on a normal Linux distro. Gives most of the features I care about, with basically no downsides.

Nix + Home Manager is a good combo if you don’t want to go the whole way. But yes, I would recommend starting with just Nix.