Yes, you are certainly correct to be annoyed. If she is frightened by creepy men, she can simply say that rather than literally lumping you in with disrespectful creeps. It is not anyone else's job read into context that she refuses to give when she makes such remarks. If she repeatedly says this, you should tell her that it hurts you when she says it. Her response should tell you whether or not she respects you as a person.

Speaking from personal experience, I have had some bad experiences with exes, including a very abusive ex who actually tried to kill me when I broke it off. These experiences have left me somewhat weary of certain behaviors from women, but I would absolutely never say that I hate women in general. If this is something I said, I'm sure the people who care about me would ask me to see a therapist.