| ▲ | nylonstrung 3 hours ago | |
I think the panic around distillation misses the fact that US labs also benefit heavily from Chinese breakthroughs like Deepseek's work on sparsity, MoE and training architecture It may be that US labs use Chinese models for distillation but we'd ofc never know because they can host the models themselves | ||