| ▲ | jckahn a day ago | |
I run Qwen 3.8 27B just fine on my Mac mini M4 24GB. I use Unsloth's Q3 XXS with 128k context. It successfully completes long horizon tasks with OpenCode. | ||
| ▲ | tristor 12 hours ago | parent [-] | |
Yes, Q3 = 3bit quant, so that's not comparable to a 4-bit quant. | ||