I always thought slashdot had an interesting concept with meta moderators. Their job was to look at how someone moderated a comment and verify if it was moderated correctly. If it was that moderator was giving more moderation points (how many times they could up/down vote something). If it wasn’t they lost points.

You would be randomly asked to meta moderate random moderations.