Remix.run Logo
visarga 4 hours ago

The system prompt part is surely cached across all users.

yojo 4 hours ago | parent | next [-]

You still pay cache token costs on API calls. Cache cost/token are 90% lower, but you pay it every single turn.

I’m not sure if they let you skip the cache write cost on the first turn. That would imply cross-user caching infrastructure or special casing the default system prompt to give you a discount. Maybe? Away from the computer but you could try a “hello” in a fresh session and see what was billed.

dcrazy 4 hours ago | parent | prev | next [-]

For Anthropic models, yes. But OP was using Claude Code with GPT.

tosh 4 hours ago | parent | prev [-]

the system prompt still takes up useful space in the context window and steers the model into unnecessary actions and over-thinking patterns