I really want a UI that visualises branching. I would like to branch out of specific parts of the responses and continue the conversation there but also keep the original conversation. This seems to be a very standard feature but no one has developed it.

Would require something like snapshotting context windows, but I agree, something like this would be nice.