| ▲ | StevenWaterman 3 hours ago | |||||||
Cached tokens are cheaper (90% discount ish) but not free | ||||||||
| ▲ | moyix 2 hours ago | parent [-] | |||||||
Also, unlike OpenAI, Anthropic's prompt caching is explicit (you set up to 4 cache "breakpoints"), meaning if you don't implement caching then you don't benefit from it. | ||||||||
| ||||||||