I suspect the next real advance will be the LLM equivalent of thin-client/fat-server evolution, a sort of "local lora" system that forms the unique part of your own agent(s) distinct from the underlying static model, and capable of dynamic learning/processing.

Could it be cloud-based? That changes the risk and scale calculus in a way that's going to take a long time to get funding into.