There were people in the German army (Wehrmacht) who wanted to have nothing in common with those criminals. Some even tried to kill Hitler and get rid of the regime.