I somehow find it better to give 2 frontier model companies 100-200/month than dropping 10 grand on a hardware that will get old in no time with bad TPS. I really want to have a fully local model but seems like one more generation wait and we will be there?

▲

jameshart 14 minutes ago | parent | next [-]

You could spend 100 a month leasing one of these for three years and get the best of both worlds

▲

henry2023 3 hours ago | parent | prev | next [-]

You just described why the datacenter business is hard and as a corollary why space datacenters will not be economically viable.

▲

tyleo 4 hours ago | parent | prev [-]

Lots of people use the Mac Mini to run the frontier models over night or while traveling. I have a rack in my basement and have thought about throwing one in. You can get a cheaper machine but Apple feels a little more, “rack and forget,” if you have less price sensitivity.

Mac Mini + MacBook Neo w/ ssh can be a better setup than MacBook Pro for many people.

▲

throwaway219450 2 hours ago | parent [-]

If it’s purely for experimentation then why not the DGX Spark/GB10? It’s up about 10% from release RRP which is quite good (you might argue it was overpriced then, but prosumer and workstation GPU prices are up 100%). 4TB NVMe is not cheap these days - it’d cost at least $500 for a stick - and you get 128GB at a similar bandwidth to an M5 Pro.

Nevermind that Apple still insists on providing base systems with only 512GB of non-upgradable SSD. The equivalent spec mini (4TB/64/10G) is almost $5k for half the VRAM. Not as good a CPU compared to the M5/6 but you also get 20 cores and full CUDA.

	▲	tyleo an hour ago \| parent [-]
		That does not sound like rack and forget. Just looking at prices it’s also way more expensive.