| ▲ | swiftcoder 2 hours ago | |
How are these high-speed providers close to matching the API rates from deepseek? | ||
| ▲ | pimeys 2 hours ago | parent [-] | |
Seems that V4.1 Flash is quite cheap to serve. Especially how it implements the cache, meaning the cache pricing can be very low depending on how you implement it in your inference engine. Depends on your use case. But if you do software development with a harness such as oh-my-pi, your cache rates are probably somewhere above 98%. Coralbricks has free cache reads, meaning it's much cheaper than the Deepseek API rates. Lithosai is more expensive especially in the ultra tier. It's if you want extremely snappy and fast responses, which is important e.g. for a personal assistant where every second counts. If you generate a lot of output, you're better off with the Deepseek API rates. | ||