I was just talking about this on the discord

The big issue I had were the scenes in between the big jokes. They're pretty expresionless, even when the voice performance is the opposite. That's the disconnect between the manga and anime. The manga can have crazy and detailed faces all the time every panel because of the format, but the anime can't possibly keep up with that. So there has to be downtime in the anime where there aren't detailed expressions, which makes the moments when there are detailed expressions feel like a punchline gag or something when in the manga it felt more natural.

Basically, the manga takes advantage of that format very well. Translating the manga to anime is just really god damn difficult by nature. They're trying their hardest with this adaptation, but as a result of difference in format there is going to be a bit of a disconnect.