Maybe 1000s of tokens per second unlocks realtime robotic decision making, and now every robot needs to continuously stream tokens to and from the cloud to operate. That could 1000x demand overnight, just to speculate :)

I would very much like it if anything that moves with appreciable mass is governed locally just in case the link drops and/or latency suddenly goes up. Motion is very unforgiving and accidents will happen if that's not taken into account.

I think you just found what we will see in the S-1 prospectus of OpenAI

Seems unsafe to make locomotive decisions remotely

Think about the agents buying computers for their agents. /s