Remix.run Logo
dofm 15 hours ago

FWIW on my M1 Max I have not really seen any advantage at all from MLX.

I am fully prepared to believe the benefits accrue more to the M3 and up (because of changes to the Apple Neural Engine).

But with the models I've tested, unless I am missing something, the performance of GGUFs in llama.cpp has been better in some cases.

I still have not had results from Gemma 4's MTP be really worth it, to be honest; but with the Qwen 3.6 MoE it is measurable. Maybe with newer kit it is more meaningful.

(There is every chance that the above is not the experience of anyone who really deeply knows what they are doing; it feels like I am a perpetual novice at this stuff)