Remix.run Logo
Claude Savings with context caching awareness(github.com)
2 points by FrancescoMassa 11 hours ago | 2 comments
FrancescoMassa 11 hours ago | parent | next [-]

We have a new update for brick : with feedbacks from users we inserted context caching aware routing. so that savings are improved even if switching models transfers context from one kv cache to another. we introduced a tier1 compaction algorythm that makes the router cheaper while mantaining performances. Try it out with brick claude settings > cache aware routing > smartsqueeze

Jimmy0252 11 hours ago | parent | prev [-]

[dead]