Remix.run Logo
epicureanideal a day ago

You may be correct, but I wonder if we'll see Mac Mini sized external AI boxes that do have the 1TB of RAM and other hardware for running local models.

Maybe 100% of computer users wouldn't have one, but maybe 10-20% of power users would, including programmers who want to keep their personal code out of the training set, and so on.

I would not be surprised though if some consumer application made it desirable for each individual, or each family, to have local AI compute.

It's interesting to note that everyone owns their own computer, even though a personal computer sits idle half the day, and many personal computers hardly ever run at 80% of their CPU capacity. So the inefficiency of owning a personal AI server may not be as much of a barrier as it would seem.

saltcured 10 hours ago | parent | next [-]

But will it ever lead to a Mac Mini-priced external AI box? Or will this always be a premium "pro" tier that seems to rival used car prices?

seanmcdirmid a day ago | parent | prev [-]

> but I wonder if we'll see Mac Mini sized external AI boxes that do have the 1TB of RAM

Isn't that the Mac Studio already? Ok, it seems to max at 512 GB.