Is there something wrong with PyTorch? I’ve heard people complain a lot about their GPUs. I’ve only used MI250x in an HPC, but PyTorch worked fine.

It's due to ROCm, think equivalent of CUDA lower level drivers, which is well problematic.

There's huge upswing in using Vulkan Compute which works across NVIDIA, AMD, and Intel (and even others), and which is apparently much easier and stable to run on AMD