| ▲ | doctorpangloss 6 hours ago | |
Two Mac Studio M3 Ultra 512GB and 1 USB cable can run all those models - maybe about $30,000 in hardware - and based on my benchmarks, those Mac Studios were twice as fast as the A100s on Deepseek v4 Flash, which has a quantization but not really a lossy one. | ||
| ▲ | root_axis 5 hours ago | parent [-] | |
That cannot run KimiK2.6 or GLM5.1 i.e models within the ballpark of anything offered by frontier companies. | ||