Remix.run Logo
▲ hypersoar 8 hours ago

I actually think a desktop makes sense if you want to run local LLMs. I have an M4 Max laptop left to me when I got laid off. It can run good-sized LLMs, but the system heats up, the fans blast off, and it rips through the battery in under an hour. I'd rather have a desktop set up as a private inference server that I could connect to remotely.

▲hbn 4 hours ago | parent | next [-]

But the iMacs only have the sans-adjective M-series processors. And is it really gonna have optimal thermals in that thin frame pressed against a big, bright high-res screen?

If you need to push performance you'd probably go for a Mac Studio, no? Or at least a Mini.

▲asdff 6 hours ago | parent | prev | next [-]

Desktop maybe, but Imac that costs more for the same specs of the mini you can shove in the drawer in a desk? I mean with the airspace taken up by an imac you only remotely connect to you could probably have two side by side stacks of I don't know, maybe 20 mac minis each? HPC territory.

▲pathartl 7 hours ago | parent | prev [-]

Bingo, desktops are still king for actual raw processing. Apple laptops are great, but they're still just computers, given proper cooling and power they can perform even better.

▲asdff 6 hours ago | parent [-]

An imac doesn't strike me as a desktop with proper cooling. Maybe they do some funny business in the chassis, but its pretty clear that airflow has been put on the bench in favor of having a sexy thin backside.