| ▲ | Havoc 3 hours ago | |||||||||||||||||||
The favourable comparisons to Gemma 4 and qwen3.6 look promising! | ||||||||||||||||||||
| ▲ | cmrdporcupine 3 hours ago | parent [-] | |||||||||||||||||||
Those two offer MoE variants, this doesn't seem to. Dense model makes it dog slow on anything without HBM. Max 15tok/sec on decode on DDR5 systems like a Spark or a Strix Halo -- and that's at 4 bit quant. | ||||||||||||||||||||
| ||||||||||||||||||||