| ▲ | hypersoar 8 hours ago | |||||||
I actually think a desktop makes sense if you want to run local LLMs. I have an M4 Max laptop left to me when I got laid off. It can run good-sized LLMs, but the system heats up, the fans blast off, and it rips through the battery in under an hour. I'd rather have a desktop set up as a private inference server that I could connect to remotely. | ||||||||
| ▲ | hbn 4 hours ago | parent | next [-] | |||||||
But the iMacs only have the sans-adjective M-series processors. And is it really gonna have optimal thermals in that thin frame pressed against a big, bright high-res screen? If you need to push performance you'd probably go for a Mac Studio, no? Or at least a Mini. | ||||||||
| ▲ | asdff 6 hours ago | parent | prev | next [-] | |||||||
Desktop maybe, but Imac that costs more for the same specs of the mini you can shove in the drawer in a desk? I mean with the airspace taken up by an imac you only remotely connect to you could probably have two side by side stacks of I don't know, maybe 20 mac minis each? HPC territory. | ||||||||
| ▲ | pathartl 7 hours ago | parent | prev [-] | |||||||
Bingo, desktops are still king for actual raw processing. Apple laptops are great, but they're still just computers, given proper cooling and power they can perform even better. | ||||||||
| ||||||||