| ▲ | JacobAsmuth 3 hours ago | |||||||
It has double the active params. | ||||||||
| ▲ | K0IN 3 hours ago | parent [-] | |||||||
yeah but using the rule of thumb (I see floating in the Internet) which is sqrt(#params * #active params) which would give sqrt(284B*13B) = 60B, so deepseek should perform better. | ||||||||
| ||||||||