You have it backwards. In prisoner's dilemma if both stay quiet they are still punished, just less so.