They're getting increasing demand for tokens at an accelerating pace.

Is that the same as storing state in a DB and on a filesystem though?

Like, I get there are other features they have, and things like history, but I don't think it's quite the same.

Isn't most (not all) of the LLM's resources stateless compute to a large degree?

(Not defending MS at all though, I currently can't create a PR on the required branch for my work (won't load the branch list) and their availability is really bad recently).