| ▲ | justinclift 2 hours ago | |
Looks like it. This quant ( https://huggingface.co/inferencerlabs/Kimi-K2.6-MLX-3.6bit ) says: > Q3.6 typically achieves useable accuracy in our coding test and fits within a 512GB memory budget This one ( https://huggingface.co/mlx-community/Kimi-K2.6-MoE-Smart-Qua... ) though says it fits on a 192GB mac: > M3/M4 Ultra 192GB+ (fits in ~150GB) | ||