| ▲ | atif089 5 hours ago | |
So if I have to set this up on my 24GB MBP what'd the right configuration and tuning look like? | ||
| ▲ | suoloordi 4 hours ago | parent [-] | |
Checkout MTPLX. I use the Youssofal/Qwen3.8-27B-MTPLX-Optimized-Speed model and I get around 12 tok/s on a 36GB MBP. | ||