The models don’t get better on every dimension as they scale up - there’s trade offs.

I’m convinced specialised models are the way but this means writing off the investment in existing assets which they won’t do for obvious reasons.

This was my suspicion. They had a bad training run that was really good at a few things.