I'm a big fan stylistically of what https://taalas.com/ is doing, as far as models baked into silicon. If you haven't tried their chat it's absurdly fast (and also very very dumb)

That implies to me that in the future we'll have models as good or perhaps better than the state of the art at the moment, but on hardware chips that can be put in places where you can't currently locate a datacenter, and operating at hundreds of times better power efficiency, which sounds pretty great.