And I wish people wouldn't flag a post because they disagree with it, rather than because it violates the rules.

Yes I agree with that, but most flagged comments I catch usually are pretty blatant violations of the comment guidelines.

It does happen often enough that I kind of wish there was negative flagging weight applied to abusers.