Remix.run Logo
charcircuit an hour ago

>and shouldn't charge more and more the longer the conversation gets

The cost of generating token N is O(N) with KV cache so it's unrealistic to expect to not be charged more the longer the conversation is if you are looking for the minimum price.