Hmm. I would express how you feel to those women who were making those faces. Try this next time.
You: I'm a little nervous to say this but I notice you are making a face when you look at me and I'm feeling very uncomfortable because I need to be able to support my daughters and I would like to feel safe doing so.
Then immediately make a request that starts like this
You: could you tell back what you just heard me say?
You're going to want to make sure they don't hear you criticizing them. So if you get back
Mom: I'm so sorry I'm such an idiot. I didn't mean to make you feel that way.
You're are going to want to clarify yourself
You: thank you for telling me what you heard. I can see I didn't matter myself clear. I just need to be able to support my kids and feel safe doing so.
If you get to the point where you feel understood you can ask this question.
You: how do you feel when you hear more say that?
If she's really honest she'll say something like this.
Mom: well I'm relieved. I hear so many stories about children becoming the victims of violence, I'm happy to see a father caring for his children like you are