Remix.run Logo
fermuch 7 hours ago

xhigh tells it to overthink and re check everything. Low tells it to only do the minimum thinking necessary. I would suggest to give qwen medium which doesn't inject any thinking directives into it and also to give as much context as you can, ideally around 500k tokens or even 1M if you can. Big complex tasks like these make the model hit the compaction trigger a lot and they end up re thinking the same thing several times in my experience.

kennywinker 5 hours ago | parent [-]

Doesn’t it max out its context at like 256k?

SwellJoe 4 hours ago | parent [-]

It supports YaRN. From the model card: "Context Length: 262,144 natively and extensible up to 1,010,000 tokens."

But, ~256k is all I can fit on my dual 32GB setup, and it gets slow as heck at 256k, anyway. I think just convincing it to chew less and do more is probably the right solution for Qwen 3.8 27B, though I guess we need some benchmarks to get the feel for how much intelligence you lose by choosing a lower reasoning level.