Remix.run Logo
albert_e 21 hours ago

> If you accidentally send a request with say, ~700k context already accumulated in a session which is outside cache TTL, you're paying full cost of these 700k tokens.

Thinking aloud:

The harness UI should probably implement a timer that shows whether you are still within Cache TTL since your last turn of the conversation.