Why you gotta tear someone else down like that?

You should really ask yourself that same question.

Is it so bad to be annoyed by billionaire worship?

You can be annoyed by whatever you want, but disparaging someone actively helping others is shitty.

I would try to give back as much as we could if we had that much wealth

What if I told you that being poor - which is an extremely relative term, since a poor American is wealthy in much of the rest of the world - doesn't prohibit you from giving back your time, experience, etc...?

How would it make you feel if someone in a less privileged place in the world - most of the world, btw - judges you for sitting around and playing video games and being "annoyed" and judging others instead of helping?