Is it worth staying?

Considering the situation, the chances of him even being able to take your son is slim to none, even if he wanted too. It's significantly more likely that he will disappear and tell everyone that you "don't let him see his son," though he won't make any effort to see him or do the bare minimum to contribute. Leave him. But if you can, make sure you have a good support system in place because being a single parent is exhausting and overwhelming. While you are doing the majority on your own already, his tiny crumbs of "help" will seem like a lot when you have no help at all ( even though it is an illusion.) I also suggest getting counseling if you can. Because many of these behaviors make me think he is emotionally abusing you. Would you want to raise your son to act the way he is acting? There are other men out there who will treat you with respect, help you without asking, do more then the bare minimum, and overall set a better example. If you need someone to talk too feel free to PM me. I've been through a similar situation and I know it feels very lonely.

/r/Parenting Thread