Remix.run Logo
▲ WildGreenLeave a day ago

I've been using claude-bridge [0] and pi-vcc [1] for compaction and it has been a complete life changer. I'm slowly phasing out my Anthropic use for Mistral but I've used it for months without issues.

[0]: https://pi.dev/packages/pi-claude-bridge?name=claude-bridge [1]: https://pi.dev/packages/@sting8k/pi-vcc?name=pi-vcc

▲nathanfig 9 hours ago | parent [-]

That compactor does not use any LLM calls and you find it sufficient? I'm surprised that works well.

▲selcuka 7 hours ago | parent | next [-]

It is lossless, and comes with a search tool (called pi-vss-recall).

It summarises the context, but doesn't touch the full conversation history. At the end of compacted context, there is a small note that tells the LLM to use pi-vss-recall to search for a specific keyword if needed.

▲WildGreenLeave 5 hours ago | parent | prev [-]

I tried it out thinking it would suck, but I've been compacting this way for over 6 months now and I am not going back. Somehow, magically, it works great for me at least!