Remix.run Logo
kamranjon 3 hours ago

Whoa whoa whoa, 118b params, 8b active MOE, long context reasoning, open weights - music to my ears. Hadn't heard of this lab before but I am very excited, will definitely try this out tomorrow - this is a real sweet spot I think in terms of model size and performance.

svclaws 2 hours ago | parent [-]

If the numbers are legitimate then our prayers have been heard