I don't know.... With all those approaches to run AI in your own premise, people need their own hardware. It makes them independent. Of course hyperscalers and AI labs don't like that, but I argue that consumers prefer independence over some costs of operations. If this would be the case, people wouldn't own cars.

Yes but we are waiting fro the release of the right hardware to enable local inference efficiently.

These times are confused because all the available solutions are suboptimal for NN inference in the consumer market.