Remix.run Logo
Azantys 2 hours ago

Its 27B not 37B and having just 27B in total and 3T and like 30B active of those is still totally different. A 120B with 5B active is still much slower than a proper 5B. Just like the new Ling 3.0 Tiny with 8B and 1B active only gets around 120tk/s compared to 250tk/s which a real 1B one gets on my hardware.

jakswa an hour ago | parent [-]

Thanks for mentioning Ling 3 Tiny. This model has completely bypassed me and seems promising for how small it is.