| ▲ | PcChip 5 hours ago | |
I think flash usually means MoE, not dense | ||
| ▲ | jephs 5 hours ago | parent | next [-] | |
Every frontier model is MoE these days! Flash or otherwise. Sparsity just gets you more bang for your buck. | ||
| ▲ | terhechte 5 hours ago | parent | prev [-] | |
Not really. “Flash” generally means fast or cost-efficient, not specifically MoE (Mixture of Experts). - DeepSeek V4 Flash: 284B / 13B active MoE - DeepSeek V4 Pro: 1.6T / 49B active MoE - DeepSeek V4.1 Flash: 552B / 8B input, 16B output MoE | ||