Remix.run Logo
jdcasale 5 hours ago

I'd consider a 1tb machine at 20k, but I'm not going to pick up a 256gb one at all. 1TB fits a frontier-ish model in memory without massive quantization, which is a very interesting capability for a non-rack piece of compute.

epolanski 4 hours ago | parent [-]

But why...?

At that point just rent proper GPUs in the cloud, you'd have way more power and pay only what you use for.