OK, you are definitely NTA for communicating how you feel. He certainly is for his reaction, how he spoke to you, and the way he tried to turn it on to you.
Now though, if I may, I would like to share some experience as someone who's wedding was 13 yrs ago (still married).
First of all, your friendship situation sounds EXACTLY like mine..! My husband had big social groups from school days, I had one good friend from school and the rest were work friends. And honestly, my best and closest friends have all come from work, so I see no issue there! And the good friend from school? Well she was my maid of honour and today we don't even speak - a story for another day, but an example of how friendships can be fickle and who knows who you guys will still be friends with in 10 years time...
Nobody tells you how stressful just doing the guest list can be. Especially if you have a head count limit. I saw a nasty side to my inlaws when they hung up on my husband and had in him in tears (I had NEVER seen him cry!) over demanding that he invite family he barely knew over his own friends (ps they weren't even paying for anything...).
Compromises have to be made, and there will be someone there who you aren't particularly a fan of, and a few people that you don't even know! (Guest partners for eg) But on the day, you are going to be so busy, and so overwhelmed with guests and all the events that it's not going to matter to you for that one day. (And hey, you can give the photographer the heads up to try and avoid that guy being in your photos lol)
However the insult of being a 'friend' who doesn't get invited will last forever. Particularly if he is in one of his closer groups. And that is something your finance will have to continue to deal with.
Think of it a bit like having to invite your cranky, mean boss. You hate him, you don't particularly want him there, but for the sake of your career it's best you do. In the end they wont have any affect on your night, and hey, at least they have to buy you a present! (Lol)
I think the best course of action is to ask your fiance to speak to him about his behaviour on the night, and be prepared to kick him out if he does end up a drunk jerk or something. Maybe even assign someone you trust to 'watch him' for the night and keep him in his place.
And as I said before, I guarantee 10 years down the track you will look back at your guest list and there will be people that you never see now, or haven't spoken to for years, but you won't care because it was an awesome night! Let's hope he's one of those...
I hope that all makes sense. All the best with your wedding, and I hope this little speedbump passes quickly!