Sorry you're having those feelings, but what kind of ignorant people are you around that even think, let alone say those things? Learn to ignore them, they and their thoughts aren't worth your time. Life is to short to give it to them, just move on and do your thing the best you can and the way you feel is best. That's all you can do.
Focus your thoughts on positive people and thoughts, and more importantly on living your life your way. Every person that's ever lived have made mistake after mistake. Who cares? We're all just human, and here to learn and grow and you can't do that without making mistakes, and you can't do anything if you pay attention or give credibility in your mind to negative, ignorant people because there's an endless supply of them.