> The fact that models aren't continually updating seems more like a feature.

I think this is true to some extent: we like our tools to be predictable. But we’ve already made one jump by going from deterministic programs to stochastic models. I am sure the moment a self-evolutive AI shows up that clears the "useful enough" threshold we’ll make that jump as well.

Stochastic and being unpredictable are two different things. I would claim LLMs are generally predictable even if it is not as predictable as a deterministic program.