you still have to train all the stuff you want to run locally.

For most people, they will use the models included in iOS and Android on their phone.

When all these datacenter projects halt (as is their trajectory), at some point someone is going to ask about what to do with the unused GPUs. Those will probably sell to bitcoin miners or other new AI companies that know how to use exotic sources of power, though at smaller scales.