Drivers are dependent on a lot of things. Firstly, using Ubuntu means your OS by default does not come with any proprietary drivers, so you're using third party drivers for any proprietary hardware you have. nvidia drivers for example work wonderfully, but Ubuntu uses the 3rd party nouveau drivers instead.

In personal experience I have had more driver issues using Ubuntu than any other OS I've tried because of this. I would suggest maybe testing out manually force installing some of the proprietary drivers to see if that helps your situation. If so then you know the 3rd party driver is the issue there. If it doesn't then you have to start figuring out what else it could be.

For reference I game on Mint with an RTX 2060 with no major issues using the nvidia drivers.