Remix.run Logo
rcarmo a day ago

I would love to try out one of the mini-PCs that ship this, but they seem to be made of either platinum (hugely overpriced in EU) or unobtainium (no retailers carry them here, and getting something direct from China is dicey warranty-wise). ROCm 7 looks to be working already under most Linux distros and having this as a workstation with a local LLM or a “home inference server” with Ollama and a few services seems like a great solution.

cpburns2009 19 hours ago | parent | next [-]

Have you looked at Corsair's AI Workstation 300 Desktop PC? [1] It's 2000-2700 EURO depending on model, and taking VAT into consideration it's comparable to the 1700-2300 USD pretax prices.

[1]: https://www.corsair.com/eu/en/c/ai-workstations

rcarmo 19 hours ago | parent | next [-]

No, but it falls into the platinum side of the equation. I can rent a cloud GPU for a few hours a month and come out ahead.

adgjlsfhk1 13 hours ago | parent | next [-]

I don't think there's any computer hardware that is now economical to buy and use a couple hours a month than to rent

overfeed 15 hours ago | parent | prev [-]

If the economics don't work out, perhaps this product is not for you and you're better off renting.

hau 10 hours ago | parent | prev | next [-]

I generally agree with gp. Checkout with your link says "This item is currently on pre-order" btw. Retail mini-pcs are somehow harder to obtain than general purpose ones.

tonyhart7 5 hours ago | parent [-]

probably because chip itself is shipped somewhere with "bigger margin" product

mini pc with that much compute power is only enthusiast home lab mainly audience

any enterprise or regular homelab wouldn't even need it hence why its hard to have it available

porphyra 9 hours ago | parent | prev [-]

Seems about the same price as the Minisforum MS-S1 Max and Framework Desktop in that case.

mandelken 15 hours ago | parent | prev | next [-]

I ordered the framework desktop 395 - 128Gb edition for just under 1900 eur. With some extras I paid just over 2000 incl shipping to EU. Didn’t feel overpriced to me.

erinnh 12 hours ago | parent [-]

I looked just now and it cost 2500 euro without any storage.

Was it on sale or something?

mandelken 11 hours ago | parent [-]

Huh, indeed, above 2300 eur now. I made a deposit earlier this year and it shipped in August, didn’t see the price increased.

dangus 19 hours ago | parent | prev | next [-]

ROCm is making great progress but I’ve had enough hiccups (desktop with RX9070XT) that I’d still recommend those looking for AI capability to continue using an Nvidia or Apple solution for the time being.

Still, I think it’ll be quite equivalent soon.

I think one of the best AI systems in terms of price/performance is still just to build a desktop with dual RTX 3090’s (of course you’ll need an board that supports dual cards) and toss it in a closet.

Tuna-Fish 19 hours ago | parent | next [-]

It depends on what you are doing. A lot of people who want to do local inference want to do it using much larger models than what can be fit onto a RTX3090, and Strix Halo is such a hit because it gives you reasonable (not great, but good enough to not be outright painful) performance with 128GB of memory.

geerlingguy 18 hours ago | parent [-]

Also, Vulkan is great, and much more stable. Plus tends to work great for new, and even very old, graphics cards.

dismalaf 17 hours ago | parent | prev | next [-]

At this point Vulkan will just take over. AMD and Intel are fumbling ROCm and SYCL, whereas Vulkan already ships nearly everywhere.

almostgotcaught 16 hours ago | parent | prev [-]

> ROCm is making great progress

is the progress in the room with us?

wmf 6 hours ago | parent [-]

Yes? For example, ROCm on MI355X is working fine a month after release; it didn't take a year.

21 hours ago | parent | prev [-]
[deleted]