| ▲ | hiq 9 hours ago | |
I didn't know about this limitation from openrouter, and I thought plenty of users were using it to quickly switch as needed without incurring such a penalty. Why does there seem to be so many users then? Are some folks just fine paying multiples of what they could? | ||
| ▲ | irthomasthomas 8 hours ago | parent [-] | |
I really don't know. It was built before prompt caching was common, and the switching cost was much lower. | ||