It does mean the males can't evolve further though, so at some point this will die out when situation changes and those males can no longer survive as well.

Maybe slower evolution but bacteria reproduce by cloning and they have no trouble evolving.