I'll offer a different perspective. It sounds like both of you are not considering one another's feelings.
You also talk a lot about how your husband is part of the money problem before and during your marriage while saying you actually have the problem. Can you provide some numbers for that? If you're overspending on yourself way more than what you give to your husband for bills or whatever, I think even the way you worded your post is dismissive of your role. What kind of job does your husband have? What is the balance of income like between the two of you? Marriages aren't 50/50, so if you make more, it makes sense that you'll cover more than half of the bills.
Red flags on your husband's part:
Imo, both of you are making mistakes. It's gotta be horribly awkward and uncomfortable to live in a house owned by your in-laws who don't like you. You need to understand that and take it into consideration even if the solution isn't to move out. Maybe find a compromise (your parents can find new tenants, that's a bad excuse) - live in your parents house until after you've recovered from the birth of your baby? That gives your parents time to find people to rent the place. Plus, you can move out and still have a great relationship with your parents. As long as he understands that is a compromise, it sounds like a healthy option. I love my SO's parents but there's no way I'd rent a house from them. Money + family is a recipe for disaster.
The biggest thing the both of you need to do is recognize that each of you is making mistakes here. Only then can you move forward.