A REPL + immutability?

Does immutability implies using only open weight models? Both Anthropic and OpenAI keep deprecating/removing ability to run older versions of their models. And that means all previously recorded prompts would now produce slightly different output.