>Eventually models will be trained to do this themselves

That is what I wonder. Two things.

1. Is there enough training data in that format, to do it?

2. Is there enough incentive for the LLM companies to do it? I mean they got to charge the client for the tokens upto that point..so..

1. In "verifiable" domains ML is not limited by training data any more. Models can help generate the training data and/or learn the objective through reinforcement learning.

2. Yes, because the most capable model is the only one that can charge a premium. The rest is a commodity.