Not all speech should be allowed.
> But who decides what is legal then?
Laws and judges.
... written and appointed, respectively, by the worst politicians you can imagine.