Remix.run Logo
gunalx 2 hours ago

3.5 9B can do thinking. Its just disabled by default in its gguf chat template.

liuliu 2 hours ago | parent [-]

It is disabled because it doesn't work :) Try it and see the doom loop it gets itself in.

b89kim 9 minutes ago | parent [-]

I had no failure mode in 3.6 9B thinking with llama.cpp. After release, there were updates for both model and llama.cpp.