Appending more context to the existing prompt means it's a different prompt still... The text isn't the same

I'm not sure what your point is?

Think of it like an append only journal. To correct an entry you add a new one with the correction. The LLM sees the mistake and the correction. That's no worse then mutating the history.