Correct. And to add: it only applies to comments; non-moderators cannot downvote stories