In 99.99% of the cases the accusation is leveled, they're not, and in the remaining ~0% of cases it's still better to refute their argument than to call them names.