I tested some image and text generation models, and generally things just worked after replacing the default torch libraries with AMD's rocm variants.