Yes I agree with that, but most flagged comments I catch usually are pretty blatant violations of the comment guidelines.

It does happen often enough that I kind of wish there was negative flagging weight applied to abusers.