The problem is that if the AI companies pass through the actual costs they're incurring, then charges to those companies will >10x.

If the companies don't see that kind of value (so LLMs don't become dramatically better in some kind of quantum leap from where they are now), they won't want to pay those costs. Already, most AI projects in corporations tend to fail.

If the efficiency of LLMs gets 10x better, then either corporations will "private cloud" their own AI or start using competitors that aren't carrying those kinds of debt loads from the "gold rush" phase.