Think of it from his perspective. It sounds like he's under some more stress, potentially from the baby, and wants to get some more sleep. Then you're deciding to blow him to in a way "guilt" him into waking up earlier to have breakfast with you. Now, you're going to tell him how this is him being selfish.

I mean, he's never said "I'll only wake up early if you blow me" and you haven't mentioned discussing why he's sleeping more. Have you even asked? He may be stressed out of his mind and just wants some extra sleep. But instead of letting him get what he needs (sleep), you're using sex to get what you want. I understand you want more time together, but from his perspective this may be bordering on some manipulative behavior on your part. You're volunteering to do something to get what you want, and are resenting him for it.

My wife is crazy stressed right now. There were piles of layoffs at her job (oil industry) and now she's stuck doing 72 hr weeks for 4-5 months to finish a few short jobs that are jammed in together. Even though she's working from home, our relationship is basically on hold for now. I come home from work, do dishes and chores, make dinner for us both when she finally finishes the day, then she hops in the shower and goes to bed early. If I decided to go down on her as a way to get more time with her, I know damn well better than to decide to call her selfish about it.

This may not be similar to your situation at all - but at least consider how relevant it is. Does it make sense that he might be going through a lot more stress somewhere? Is he dealing with the baby most of the evening so you have time to yourself? If he's being selfish by only responding to sex, are you being selfish by demanding he wake up early?