| ▲ | Claude Savings with context caching awareness(github.com) | |
| 2 points by FrancescoMassa 11 hours ago | 2 comments | ||
| ▲ | FrancescoMassa 11 hours ago | parent | next [-] | |
We have a new update for brick : with feedbacks from users we inserted context caching aware routing. so that savings are improved even if switching models transfers context from one kv cache to another. we introduced a tier1 compaction algorythm that makes the router cheaper while mantaining performances. Try it out with brick claude settings > cache aware routing > smartsqueeze | ||
| ▲ | Jimmy0252 11 hours ago | parent | prev [-] | |
[dead] | ||