Remix.run Logo
▲ woadwarrior01 6 hours ago

> A bigger dense model beats it. Qwen3.8 27B ...

How is a 27B dense model bigger than a 78B MoE?

▲SyneRyder 6 hours ago | parent [-]

The 27B has all 27B as active parameters, while Kolibri is only 3.46B active parameters. I think that's what they meant anyway.