Is that derogatory?

As a figure of speech, which this was; not so. I was explaining the point of an personal attack.

As an actual insult, assuming and throwing it at someone is an attack. It could be derogatory if what said harshly generalizes a majority or group.