Remix.run Logo
m101 7 hours ago

I think the most interesting thing about this, that I can tell so far, is the cache hit discount. Anyone who had an autocompaction threshold optimised for their use case should consider upping it from where it is.

I would be interested in whether someone has done research here on these things as it seems a fairly complicated function to work out, and use case dependent. (?)

In some sense an expired kv cache is basically like an expensive cache hit, so your compaction token threshold should come in. Ideally claude code should allow you to vary the autocompaction threshold to vary with time since last token, but it doesn't of course. This perhaps suggests that someone should manage claude code through their own intermediary agent who manages these sorts of rules.

Lastly, I strongly suspect that anthropic isn't offering this price cut out of the kindness of their hearts. I am sure that they are to some extent banking on people not reacting to their price cut and leaving their autocompaction thresholds unchanged.

[edit - looks like the discount is only for the api, so they still don't give a rats ass about subs!]