I deal with this all the time and it sucks. I'm still from "white" towns and have white skin but my family is poor and disabled. I grew up living paycheck to paycheck, and ended up a teen mother myself. I'm in college now and it actually really bothers me when I see people who come from families with more money or get to experience free time and hobbies that are out of my reach. The jealousy is a real feeling that really eats at me. (Then at my part job I deal with people who are working there just to avoid new stuff/trips and customers that have hundreds to spend on their children's liesure) I've spent lonely nights contemplating how I'm going to claw my way out of my economic social situation into something better (and get off this island because holy hell this place is toxic). I completely understand your plight and I only imagine with a different zip code or a different skin color how worse off Id be.

Try your best not to internalize it. Focus on bettering yourself, making money, and being grateful what you do have. You can focus on giving back to your community on the side but don't let pilanthropy take away from your education or personal life. Reach your goals and be an example against people's unspoken implicit bias, and make money so you can give your children the experiences you never received.