You had me until:

More importantly, racism is all about power.

Racism is : prejudice, discrimination, or antagonism directed against someone of a different race based on the belief that one's own race is superior.

I think you were right in saying that "black man late" is a racist statement due to its negative connotation toward black people as a whole, but the "racism is all about power" argument always irks me. People who aren't in a position of power can certainly be prejudiced, discriminatory, or antagonistic toward people who are in a position of power.

If an individual feels free to exercise racism so long as their target is in a position of power (say a judge or a cop), it is easy to extend that racism toward the group as a whole. Our goal should be to stamp out racism completely, not normalized it for some, and eradicated it among others.