Firstly I want to say you sound pretty angry about this and that's ok. You have the right to feel that way. But I'd ask you to consider this, why are you focusing on the negative side of the issue? It's never helpful and it only leads to feeling more angry and disillusioned.

I think most people can at least see that skin colour does lend people certain privileges. Some will acknowledge it. Some won't. You can't change that. What you can change is your thinking. Stop thinking about privilege and think of this: you can do any thing that a white man can do. Anything.

Sure, that doesn't mean that the playing field is level. You might have a few more hurdles and biases to face. You might get what you set out to get. You might not. But at the end of day you are able to. Embrace that and let it fly in the face of any privilege that you think is holding you back.

I was once told by my therapist (Christ, I've become that person that quotes their therapist..) that we become saddened or angry when we stop looking for ways to take control of things. This is one of those cases where people let themselves sit with chip on their shoulder about someone else's life instead of taking control of their own. Don't let the idea of privilege do that to you.

Also I'd like to add that not all white men are out to "reap the benefits of privilege" as you say. You're painting with a very broad brush there. See every person for who they are. Peace :)