| ▲ | jdcasale 5 hours ago | |
I'd consider a 1tb machine at 20k, but I'm not going to pick up a 256gb one at all. 1TB fits a frontier-ish model in memory without massive quantization, which is a very interesting capability for a non-rack piece of compute. | ||
| ▲ | epolanski 4 hours ago | parent [-] | |
But why...? At that point just rent proper GPUs in the cloud, you'd have way more power and pay only what you use for. | ||