No, it does not make you a "pussy" or non-confrontational. Everyone has their own way of dealing with conflicts and there are many different approaches to resolving them. Choosing not to hit someone back when they hit you is actually a mature and responsible way to handle the situation, as physical violence is never the answer.
It is important to find ways to assert yourself and stand up for yourself in a non-violent manner. This can involve setting boundaries, communicating clearly and respectfully, and seeking help or support from others if needed. It takes courage and strength to choose non-violence and to resist the urge to respond with aggression.
Remember, violence only leads to more violence and can escalate a conflict to a dangerous and harmful level. It is always better to seek peaceful solutions and find ways to resolve conflicts in a constructive and respectful manner.