> Can you explain why a low-hanging optimization that would reduce costs by 90% without reducing perceived value hasn't been implemented?

Because the industry is running on VC funny-money where there is nothing to be gained by reducing costs.

(A similar feature was included in GPT-5 a couple of weeks ago actually, which probably says something about where we are in the cycle)