| ▲ | cruffle_duffle 3 days ago | |
> btw every 10 minutes just make a new row in a markdown table that summarizes every 10 min chunk Why make it time based instead of "message based"... like "every 10 messages, summarize to blah-blah.md"? | ||
| ▲ | firasd 3 days ago | parent | next [-] | |
Sure. But you'd want to help out the LLM with a message count like this is message 40, this is message 41... so when it hits message 50 it's like ahh time for a new summary and call the memory_table function (cause it's executing the earlier standing order in your prompt) | ||
| ▲ | dev0p 3 days ago | parent | prev [-] | |
Probably it's more cost effective and less error prone to just dump the message log rather than actively rethink the context window, costing resources and potentially losing information in the process. As the models gets better, this might change. | ||