| ▲ | sunaookami a day ago | |
Same problem with every chinese model currently, they overthink way too much and take too much tokens and time. | ||
| ▲ | embedding-shape a day ago | parent | next [-] | |
More or less, yeah. I've found mild success with deepseek-v4-flash though, and also Qwen3.5-122B-A10B-NVFP4 running locally, especially in terms of "doesn't overthink every single prompt" and somewhat reasonable quality. Really wishing for a 3.8 update of the 122B variant, that'd be really competitive (for local usage) :) | ||
| ▲ | EgregiousCube a day ago | parent | prev | next [-] | |
A consequence of aggressive distillation? | ||
| ▲ | szundi a day ago | parent | prev [-] | |
[dead] | ||