I don't think you should be downvoted. You raised a valid point and people are downvoting you because they are disagreeing with you. I think pg should clean up downvote abilities for people who do this often via moderation. Like moderators should see a list of people who downvoted what and just one click nuke their downvote privileges.
Obviously I don't think I should be downvoted either since it's an accurate comment. :) But I am quite fine with moderation working the way it does - it'd be better than arbitrary moderation "nuking" privileges.
A model where certain threads are curated and used to measure how valuable someone's voting is might be helpful in weighting votes. But that sounds like a lot of work for probably little reward.
Meta-moderation on /. was like this. Moderate the moderation, if it was deemed fair/appropriate then you were more likely to get to moderate again later. If it was deemed unfair/inappropriate you were less likely to receive mod privileges.
