Me and a few friends did just this at a halloween party that had around 100 people, and it wasnt exactly the reaction we expected.
Noone really cared.
You'll get one or two people who actually listen to jazz and are wondering what's going on with the piano in an amazing accompaniment, but those people are probably going to know that bob archer put out an album with great musicians. And music snobs who aren't particularly into jazz will say almost the same thing, without the knowledge of John benjamin having an all star cast while he pretends to know how to play piano.
I was hoping for a more dramatic result, but very rarely does a gathering of friends and friends of friends get drunk enough yet still stay composed to turn into a dance party, so as long as the music isn't too loud or obnoxious to stifle conversation, not many people will give a fuck, unfortunately.
I did go to a party with almost exclusively musicians where the host put it on, but the people who weren't able to guess, "is this coach Mcguirks jazz album!" We're outnumbered by people who've listened to it album least once.
Not saying don't try it, just saying those album treatment my experiences. Ha.