| ▲ | Compute-optimal is not cluster-optimal(szha.ai) | |
| 13 points by yuxin_tang a day ago | 1 comments | ||
https://arxiv.org/pdf/2608.10605: Our new paper folds the systems stage into the scaling-law stage. Price every candidate architecture on what the cluster actually delivers, and the answer changes: the sparsity an MoE 'should' have depends on the cluster you train it on. | ||
| ▲ | a day ago | parent [-] | |
| [deleted] | ||