I'd ask him to leave the group. I know it sucks, but I just had a conversation with my girlfriend like this. She's never been a tabletop player, and she finds the minutiae of Pathfinder tedious, but she loves the actual sessions and is always prodding me about where the story is going. She wants her girlfriend status to grant her spoilers, which I take as a huge sign of how into it she is.

Great! I've always wanted a girlfriend who would get really into Pathfinder with me!

A few weeks ago, we went karaoking with my friends. I'm a showboat, my friends are musicians, everyone was drinking, it was a merry old time. She sat in a corner and played with her phone. She just REEKED of having a bad time. She wasn't a bad sport. She talked to people, and she is always smiling, but she was totally disengaged from the Thing At Hand. When we got home, I talked to her about it, and we agreed that when I schedule karaoke nights with my friends, she would find some other funtivity with her friends. No big deal.

Pathfinder isn't for everyone. Clearly. Combat can get cumbersome and slow even for folks like us who adore the game and the form of tabletop RPGs in general. Whatever other tools exist, the heart of Pathfinder is combat.* If you don't like that part, you're going to have a bad, bad time. If you have your heart set on Pathfinder instead of a game with a greater focus on role-playing, it's probably not going to do your relationship any favors by repeatedly going through with a time-consuming leisure activity that he merely puts up with.

*-- I know there's a lot more to Pathfinder! But combat is VERY important; he threat to life and limb is an enormous part of the game.