| ▲ | androiddrew a day ago | |||||||||||||
Curious, do you find the 3.5 120B sized MoE works better than the dense 3.6 27B? | ||||||||||||||
| ▲ | embedding-shape a day ago | parent [-] | |||||||||||||
Yeah, Qwen3.5-122B-A10B-NVFP4 produces better responses than Qwen3.6-27B-NVFP4 (both from unsloth), but I'm mostly using them for programming in various ways, mostly Rust, Clojure, Python and JavaScript, and some translations tasks, but not much more than that, so YMMV. Edit: as a concrete example, I'm working on a "optimization framework via agent harness" right now, Qwen3.6-27B-NVFP4 is often unable to actually complete the optimization within 100 turns, while Qwen3.5-122B-A10B-NVFP4 has no issues finishing within ~50 turns or so. | ||||||||||||||
| ||||||||||||||