Same here. I stopped listening about 2017 because I couldn't seem to reconcile his "keeping an open mind and hearing both sides" mentality with the actual guests he was having on.
If you want to hear both sides I give you big kudos, because most people aren't that open these days. When you choose to give people like Dave Rubin a platform to be that voice though, I have to respectfully walk away. Listening to 2 minutes of content from someone like that should have been a big red flag to not invite onto your podcast.
The other dynamic is that I got sick of hearing the same things over and over. He constantly steers every conversation back to a topic he's talked about 500 other times. It gets old.