Many improvements have come to AI that have reduced costs of inference and training, like sparse attention, and many more will arise in the future. To talk about the cost of AI right now versus the future is to talk about the first IBM computers versus the personal computing that appeared years later. The cost will go down. In fact that is what the major labs are definitely banking on.