I can imagine advancements on making smaller models work together better instead of a generalized core. Imagine a community or city having a https://pirateface.co/ so that the shard of the model that you need can be streamed in with minimal latency with your box only holding the minimal version (say deepseek v4 flash as orchestrator) of the model that you use on day to day basis.

We have overcome split brain problems before so this wont be our first

You're putting a lot of trust in uncorrupted, untrusted, unknown models (potentially).