Remix.run Logo
madduci 4 hours ago

Till now I was using successfully Qwen 3.5 and Gemma 4 at a reasonable speed

pyrale 3 hours ago | parent | next [-]

There is no way you would run a dense 27b model on that spec. I ran 3.6 27b on a 64gb ram, 24 gb vram, and it felt like the lower limit for this model with a decent context window.

If you want a better experience, maybe wait for either a moe model (like 3.6 35b A3) or a model with less parameters (like 9b). Qwen has been releasing those in the past, so maybe we’ll have them for 3.8 too.

mobelkh 4 hours ago | parent | prev [-]

were you running the MoE models? those perform better speed wise