My family was never 1% rich, but definitely upper class, especially during my father's peak earning years. My extended family and a few friends grew up lower middle class or poor, so I'd get a lot of criticism. I understand your frustration, and I used to cope with it the same way you did, but I found another strategy that worked better.

I realized that yes, I had quite a bit of opportunity because of my parents, but that doesn't mean I didn't work hard. I also realized that for many people, hard work isn't enough. There are people who work harder than me and will die as poor as they were born--my grandfather, for example. Access to opportunity and just an idea of what steps to take to achieve success are rare if you don't have successful role models. (You probably know that.)

So when the comments about growing up rich started, I stopped getting defensive and started humbling myself. I'd never talk the specifics of money, which is distasteful anyway, but I'd say, "I'm proud of myself, but I know I was very fortunate. Not just in terms of money, but in terms of good role models who showed me good careers paths and valued education. Not everyone has that, I know." I shut down the comments, and it gave me some good perspective.