If you let it happen to the extremists then it can also happen to the moderates next.
What can't be tolerated is any law that restricts or hinders freedoms of religion, speech, press, assembly, and petition.