Vegans need courage. You're standing up for a massive cause, this is not an easy path but the just one. It's the early stages of global change, a little social inconvenience is to be expected to say the least

I've been completely outcasted by society in the past, and still moderately presently, because of facial disfigurement. I understand social isolation, and I still do not sympathize with "feeling like an asshole" for not eating victims. Do some self reflection. People are fickle beings and the only one you can depend on is you. Weed out the people who still have a lot of growing up to do and attend local vegan events if possible for social needs