I definitely see a future race of who can accelerate open models and their usage locally with realistic desktop hardware.

I fully await my ai in a usb box. The models are plateauing and some clever company is secretly working on this already I’m sure of it.

Imagine baking in a model weight set in ROM with an analog computer doing what otherwise takes way too much power in digital form.