> is it fair to curtail speech because someone might perceive it as a threat?

Plenty of speech is criminally curtailed. Credible threats of imminent violence. Fraud. Perjury. They’re just tightly defined ex ante.

Threat of imminent violence clearly falls on one side of the line. There are other cases that are on the border and you can't judge so easily.