As annoyed as I get when I receive downvotes, I think for the most part looking back, the comments were either divisive (and hence got some heated disagreement-based downvotes) or probably justified as downvote-worthy.

For the most part the moderation system works. But it forces you to think very hard about how valuable your comment is.