Question:

Can a model's weights be hard-coded into a physical chip for cheap fast local AI?

Not cheap, unless that one specific model is going to be used across tens of millions of devices, with no updates, for the physical lifetime of the device.