Usually no, my memory can get a bit fuzzy sometimes myself. The only time it's ever pissed me off was when my classmate kept forgetting my name. We had half a dozen classes together, maybe more, and she'd intentionally seek me out to talk about herself. As soon as I actually started speaking in return, she'd literally just turn around which also started to piss me off. Forgetting my name after she'd just spent another 15 minutes rapidly talking about herself just infuriated me even further.

After back to back instances of this, I finally just ignored her. She'd walk in a room, try to make eye contact so she could start talking, but I'd ignore her. She remembered my name all of a sudden. Maybe she finally figured it out, maybe she just got lucky, who knows.