| ▲ | GaggiX 4 hours ago | |
The vast majority of these tokens are cache input tokens so even at API price the cost would be much lower. | ||
| ▲ | thway15269037 4 hours ago | parent [-] | |
Even with 95% cache hit, and on cheapest chinese model, it would still be in tens of thousands of dollars (I assume that of 500B tokens at least 10B would be in "output"). If we switch gears to Kimi K* then if would very quickly escalate in hundred thousands USD. | ||