The bigger question for me is , at what point does investing in higher capability general models will stop showing the ROI?

For example - What percentage of workflows require this new highly capable model? How much of it can be replaced with the software tooling around it? What I mean is if the software tooling can optimize the query over a few iterations does it get the same output as from a single shot high capability model query?

What ROI? Nobody is currently making money outside of the hardware manufacturers and hyperscalers