| ▲ | lostmsu 2 days ago | ||||||||||||||||||||||
> Small: 594 billion parameters cries in GPU racks | |||||||||||||||||||||||
| ▲ | colingauvin 2 days ago | parent [-] | ||||||||||||||||||||||
You could probably run a Q2-Q3 with 2x DGX Sparks. So...$12k at today's prices. Plenty of folks are running DS 4.1 Flash with Strata and some GPU + bulk in system memory. Maybe more like $3k-$4k? But speeds come down quite a bit. | |||||||||||||||||||||||
| |||||||||||||||||||||||