Sounds like this was a swinger club situation that favored the very few women that were present. I can see why he might be frustrated, but it is certainly not your fault. At some point if you saw that he was unhappy you might have thought to ask him about it and if he wanted to wnd the night. However, it seems like he was very accommodating to you having what sounds like a very fun evening. I would suggest looking for other avenues to explore the lifestyle such as dates with another couple, small house parties with 1 or 2 couples or even bringing a unicorn into the mix for a girl girl guy 3 some. That would certainly take his mind off the other evening that you had.