Remix.run Logo
▲ nodesocket 6 days ago

> but cost isn't one of them.

Let's do quick back of the napkin math.

  - Mac Studio M5 Ultra, 80-core GPU, 256GB memory, 2TB storage -- $11,299.00.
  - Power (385w continually 100% of month) is $40/mo (my regional) or $480 annually. Let's say power is 3x more expensive in California, which it probably is, that's still only $1,440 annually in power.
The Studio M5 Ultra has a worklife of at least 3 years.
▲klrefg 5 days ago | parent | next [-]

You have to compare with how much Deepseek costs since all the models you will be running will be inferior anyway, certainly not Opus or similar.

▲jcelerier 5 days ago | parent | prev [-]

it's going to be quite slower than remote providers, won't be able to run full models, only quantised, and for more cost than the highest Claude subscription tier where you can do roughly 60-100M token per month at 200$, e.g. 7200 for three years. It makes sense if you prioritize local AI but not really otherwise sadly.