| ▲ | zozbot234 2 hours ago | |
The full K3 model will probably be way more than 594GB, that's more of a plausible range for Kimi 2.x. You'll probably be able to test run this model at full or near-full precision using SSD offload, but only at very slow speeds - probably slow enough that you'll be forced to let inferences run overnight or even spanning multiple days. Mind you, that's still useful enough for many casual users, given that they're running a near-SOTA model! | ||