NTA but borderline everybody sucks.

You have a responsibility to communicate clearly and effectively that somebody's behavior is crossing a line before you blow up, and it sounds like you didn't really do this. You hinted around it.

Before blowing up at him, you should have told him in no uncertain terms that he needed to stop. Not "I don’t think my gender has any impact on my quality of work," and not, "I’ve also told him how ridiculously stupid it is to write comments about my gender down." But "Stop doing that shit or I'm complaining to management about it."

And if he keeps doing it, you complain to management about it in an appropriate setting.