Someone not agreeing with your lifestyle, but not doing anything to prevent you from living
Except these people do vote for individuals who will strip you of your rights, their representatives are simply a proxy for attempting to take away your rights. That is evil-doing. Why should one be tolerant of, or accept within their community, someone who wants to take away their rights? They shouldn't.
Pointing a gun at you, or electing someone to point a gun at you... you're simply being a coward and hiding from the consequences of your actions. These neck-beard losers who pretend they're doing nothing wrong by flying a Nazi flag are simply cowards who don't want to face the natural consequences of their actions.