| ▲ | minimaxir 6 hours ago | |||||||
In an agentic pipeline, the output text is 2-5% of the total tokens used, so verbosity is a nonissue costwise. Although, higher verbosity could cause input to balloon faster and potentially cost more, but that would be captured by the cost-per-task metric. But as noted by other replies, it's still lower than Opus/Sonnet. | ||||||||
| ▲ | jukea 5 hours ago | parent [-] | |||||||
You pay for chain of thought tokens as well. Ex: Imagine asking for a single number that takes 1h to compute | ||||||||
| ||||||||