Sentiment I have heard is manufactories do not want to increase die size because defects per die increases at the same time.

Meanwhile at Cerebras...heh

But I do believe that their cost per compute is still far more than disparate chips.

This is why chiplets are used.