Use nix.optimise.automatic = true in the config and perform nix-collect-garbage if necessary. With this it doesn't take much.