Remix.run Logo
JacobAsmuth 3 hours ago

It has double the active params.

K0IN 3 hours ago | parent [-]

yeah but using the rule of thumb (I see floating in the Internet) which is sqrt(#params * #active params) which would give sqrt(284B*13B) = 60B, so deepseek should perform better.

apitman 3 hours ago | parent [-]

Seems like that equation really should weight total params and active params differently