| ▲ | initsecret 6 hours ago | ||||||||||||||||
> [others] Output tokens: ~5x more expensive than input tokens. > [them] Output tokens: FREE (too cheap to meter). I'm very confused by this. | |||||||||||||||||
| ▲ | varenc an hour ago | parent | next [-] | ||||||||||||||||
The output tokens are just responses to your inputed questions and their probability. So relatively few output tokens. No unstructured text back in the response. | |||||||||||||||||
| ▲ | quotemstr 6 hours ago | parent | prev | next [-] | ||||||||||||||||
They're not doing autoregression, so all the outputs are computed in one big forward pass. Very cheap. | |||||||||||||||||
| |||||||||||||||||
| ▲ | CompleteSkeptic 6 hours ago | parent | prev [-] | ||||||||||||||||
it's our output tokens that are free (under the system one / jev column) | |||||||||||||||||