This reply is very important as she gives a good advice. I know you want to just vent OP but men aren't good at reading minds. We don't know how you feel. We can begin to understand the gist of it by falling in love and spending time every day... but even then the mentality of a woman is still elusive to us.
When you excitedly told him about it, did you bring up all the points you mentioned in this post? Reality, people oftentimes don't get to say the points they want only to remember them right after the argument or convo ends. If this balloon deflating behavior bothers you a lot, you should confront him about it. Don't corner him or guilt him or try to make this into a fight where one side has to win and one side has to lose. Arguments and fights in marriages/relationships are difficult; when you fight with your loved ones, you can only win the argument if both of you are on the same page at the end. If you "won" by being "right" while your partner is "wrong," that is not victory and will often put a distance between two people.
What your husband did to you is clearly hurtful and demoralizing. No one wants to be treated that way. If he's getting all excited to have sex with you or do some hobby like rock climbing that both of you really like, he's going to get all excited. But when you snatch it away right in his face, he's going to feel mad and demoralized. Feeling diminished and unappreciated. Despite feeling all these things, chances are your partner never intended to make you feel so hurt and negative.
Therefore confront him. Don't threaten to divorce or threaten to do this or that. Just talk to him. He won't understand unless you communicate and convey your feelings to him. And if he doesn't understand, not talking to him will put a further gap between you two as well.
Finally, I would definitely do it but... I would be careful HOW you do it. When something is important to you and he says no on the first time you talk about it, he's probably thinking she randomly picked up a hobby she will drop in a week. When you come back with the same topic and fight for it, he will realize how important it is to you. When you were a teenager fighting against your parents to pursue what you want, you've had a similar conversation. Parents will shoot you down and you have to fight for it to show them how important it is.
Try it out. I understand you weren't looking for a Dr Phil session but hopefully things work out. It seems like a decent opportunity. Maybe your husband is scared you might act like some of the other women and cheat on him. You have to communicate with him.