| ▲ | likium 5 hours ago | |||||||||||||
For $10 flat per request up to 128k tokens they’re losing money. 100 * 100k is 10m tokens. At current api pricing that’s $50 input tokens, not even accounting for output! | ||||||||||||||
| ▲ | brushfoot 3 hours ago | parent | next [-] | |||||||||||||
And a request can consume more than 128k tokens. A cloud agent works iteratively on your requests, making multiple commits. I put large features into my requests and the agent has no problem making hundreds of changes. | ||||||||||||||
| ▲ | everfrustrated 3 hours ago | parent | prev | next [-] | |||||||||||||
You didn't account for cached input tokens - some % of input tokens will be follow-on prompts which are billed at the cheaper cached token rate. | ||||||||||||||
| ▲ | indigodaddy 4 hours ago | parent | prev [-] | |||||||||||||
I mean aren't they losing money on everything even the API? This isn't going to end well with how expensive it all really is. | ||||||||||||||
| ||||||||||||||