It's not necessarily buggy IMO, I used to use Fedora for something like two years and it was quite a smooth experience. Things would rarely break on me. It's just that, even without bugs, the experience is just not quite there yet. And philosophically, it seems like it'll never be. Very rarely open source software are their own thing, usually they are born as alternatives or adaptations, so they'll mostly always be at the mercy of their closed-source proprietary counterparts. Linux gaming can get as good as it will get, but then a new thing pops up on Windows and it'll take time (can be a few days or even years) for it to work as intended on Linux.
I spent a fair amount of money on my PC, and it is kinda sad to think that I would cap myself for absolutely no reason at all by using Linux.