It is kinda a combination of the two:

https://github.com/spott/pi-task-compaction

I’m still playing with it, but it essentially has the model define a region, and mark it with begin_task, and end_task. End_task also requires a fairly hefty summery of the entire region.

It then pulls that entire region and replaces it with the summary. If the model wants it can actually look into the output that was pruned from the conversation, but in practice the summaries have been good enough it hasn’t needed to.

I’ve been using it with 5.6 sol, and even really long sessions have like 6% context used at the end.