ROCm is making great progress but I’ve had enough hiccups (desktop with RX9070XT) that I’d still recommend those looking for AI capability to continue using an Nvidia or Apple solution for the time being.

Still, I think it’ll be quite equivalent soon.

I think one of the best AI systems in terms of price/performance is still just to build a desktop with dual RTX 3090’s (of course you’ll need an board that supports dual cards) and toss it in a closet.

▲

Tuna-Fish 17 hours ago | parent | next [-]

It depends on what you are doing. A lot of people who want to do local inference want to do it using much larger models than what can be fit onto a RTX3090, and Strix Halo is such a hit because it gives you reasonable (not great, but good enough to not be outright painful) performance with 128GB of memory.

	▲	geerlingguy 16 hours ago \| parent [-]
		Also, Vulkan is great, and much more stable. Plus tends to work great for new, and even very old, graphics cards.

▲

dismalaf 15 hours ago | parent | prev | next [-]

At this point Vulkan will just take over. AMD and Intel are fumbling ROCm and SYCL, whereas Vulkan already ships nearly everywhere.

▲

almostgotcaught 14 hours ago | parent | prev [-]

> ROCm is making great progress

is the progress in the room with us?

	▲	wmf 5 hours ago \| parent [-]
		Yes? For example, ROCm on MI355X is working fine a month after release; it didn't take a year.