Remix.run Logo
▲ HeavenFox an hour ago

If they are literally sending the entire transcript and asking for a summary, wouldn't almost all of the tokens be cache hit, and therefore fairly cheap?

▲minraws an hour ago | parent | next [-]

I don't want to sound rude but even at cache hit you are burning almost input * 0.10 * context amount of tokens multiple times.

If it happens 10 times you have already accepted the same cost as the entire session fresh prefill.

People on HN are either too rich or wayyy too rich

▲simianwords an hour ago | parent [-]

Isn’t it 0.2?

▲minraws an hour ago | parent [-]

It's 0.1 I think brain fart I typed the rest correctly though after 10 summaries you still burn the same amount of tokens

▲buzer an hour ago | parent | prev | next [-]

Didn't they change the cache TTL to 5 minutes earlier this year? So depending on exact timing it could potentially be invalidated between the updates.

▲maxbond 20 minutes ago | parent [-]

It's an hour. It'll tell you the expiry time on the status line now but that information is also available in /usage.

▲buzer 17 minutes ago | parent [-]

https://github.com/anthropics/claude-code/issues/46829

Looks like what I remembered was a bug.

▲dietr1ch an hour ago | parent | prev [-]

Unless they prepend something like, "summarise this, "

▲NewsaHackO an hour ago | parent [-]

But they definitely wouldn’t do that.