| ▲ | jeffmcjunkin 6 hours ago | |
Often people are counting all tokens, including cached input tokens, for those more impressive "billions of tokens" quotes. | ||
| ▲ | rpdillon 4 hours ago | parent [-] | |
Ah, thanks, I'd missed that nuance in the other reply! | ||
| ▲ | jeffmcjunkin 6 hours ago | |
Often people are counting all tokens, including cached input tokens, for those more impressive "billions of tokens" quotes. | ||
| ▲ | rpdillon 4 hours ago | parent [-] | |
Ah, thanks, I'd missed that nuance in the other reply! | ||