Your brain has hard coded concepts like emotion and fundamental morality for your social group. People without these systems are called sociopaths and psychopaths and we generally don't want them in our societies.

I don't choose to not want to murder people around me for fun. It's hardly a prison, I think they'll be fine.