To clarify, the Mint/X11 issue isn't that. I had the Nvidia drivers. X11 had some issue with graphics switching. It worked fine on Wayland.

They kinda need a basic working driver just to make it easy to install the good driver.