Vscode recently rolled out checkpoints where you can go back to a previous state of the conversation. But it's still not enough.
We honestly need to be able to see exactly what's in the context and be able to manually edit it.