I'm not convinced that "more training" is a silver bullet here because "for you and the people you learned from" is a subset—potentially a tiny one—of the world of potential training data.

Even with newer model generations larger efforts still seem to drift back towards "default choices" vs "steered specific aims."

In many areas, "good" taste is not particularly good anymore when it's everything's default style.

The edge then becomes finding the niches that (a) can be better served w/ non-defaults and (b) have economic characteristics that make it worth catering towards those.

I think the days of one-size-fits-all huge-scale-and-ROI SaaS swiss army knives are quite numbered, but I think the replacement world could be a much more vibrant ecosystem with a much more varied set of players.