This sounds a lot like how AMD’s approach had changed on Linux and still everyone I know who wants to use their GPU fully used Nvidia. For a decade or more I’ve heard how AMD has turned over a new leaf and their drivers are so much better. Even geohot was going to undercut nvidia by just selling tinygrad boxes on AMD.

Then it turned out this was the usual. Nothing had changed. It was just that people online have this desire to express that “the underdog” is actually better. Not clear why because it’s never true.

AMD is still hot garbage on Linux. Geohot primarily sells “green boxes”. And the MI300x didn’t replace H100s en masse.

Maybe it's just that you're mostly viewing this through the LLM lens?

I remember having to fight with fglrx, AMDs proprietary Linux driver, for hours on end. Just to get hardware-acceleration for my desktop going! That driver was so unbearable I bought Nvidia just because I wanted their proprietary driver. Cut the fiddling time from many hours to maybe 1 or 2!

Nowadays, I run AMD because their open-source amdgpu driver means I just plonk the card into the system, and that's it. I've had to fiddle with the driver exactly zero times. The last time I used Nvidia is the distant past for me. So - for me, their drivers are indeed "so much better". But my usecase is sysadmin work and occasional gaming through Steam / Proton. I ran LMStudio through ROCm, too, a few times. Worked fine, but I guess that's very much not representative for whatever people do with MI300 / H100.