| ▲ | Xeoncross a day ago | |
Nice, which model quantization is this? Is it on huggingface? | ||
| ▲ | spider-mario a day ago | parent [-] | |
MTPLX is this software: https://github.com/youssofal/MTPLX I tried it with the author’s 4-bit quant of Qwen 3.8 27B: https://huggingface.co/Youssofal/Qwen3.8-27B-MTPLX-Optimized... (but no need to download it manually; MTPLX will ask which one you want). | ||