| ▲ | randomblock1 4 hours ago | |
TLDR: It keeps ~20k tokens of recent conversations, then hands the rest of the conversation to another model with a special system & user prompt. This then fills out a template with relevant information. See: https://github.com/earendil-works/pi/blob/main/packages/codi... | ||
| ▲ | skeledrew 2 hours ago | parent | next [-] | |
Can also be the same model. The main thing is that it uses a separate, clean context window. | ||
| ▲ | alansaber 3 hours ago | parent | prev [-] | |
Sounds just like opencode. | ||