This is my case, and it's actually frustrating for me. I'm not interested enough to force myself to acclimate, the way most people would have done in college due to peer pressure. So I'm stuck with either being the entertaining freak when coworkers go out for a beer, or being anti-social.
The irony of being a freakish social outcast amidst a group of nerds is not lost on me.
I started on cocktails and eventually found craft beer I like. It takes time.
But, yeah, I've been the non drinker. People don't know what to do with you, and they get annoyed. They project things onto you (like judgment), and don't even try to understand your motivations. It sucks. Groupthink is powerful and pervasive, and nerds have no problem adopting it if it suits them.
The irony of being a freakish social outcast amidst a group of nerds is not lost on me.