Remix.run Logo
anonthrownaway 2 hours ago

Here's a view for "clean:"

1. Every chat should have a context used/remaining measurement so you know when you have to ditch the current chat for a fresh one.

2. Every chat should analyze and categorizes each element of context by how useful it is towards the overarching goal of the chat.

3. Every chat has a handoff button with a "usefulness" slider (say 1-5) that shows the total size of the context based on its setting.

4. The handoff automatically creates a new chat with the desired amount of context and a prompt to get it back to where you were.

That said, I am newb and so there is some reason why these non-deterministic LLMs can't do this :-/