| ▲ | egorfine 3 hours ago | |
> As you have so much RAM I would suggest running Q8_0 directly On the 48GB mac - absolutely. The 24GB one cannot run Q8, hence why the comparison. > And just to be sure: you're are running the MLX version, right? Nah, not yet. I have only tested in LM Studio and they don't have MLX versions recommended yet. > but has since been fixed on the main branch That's good to know, I will play around with it. | ||