| ▲ | mcintyre1994 2 hours ago | ||||||||||||||||
Price is quite fuzzy too though when it's pricing tokens, because a model that's more token efficient but more expensive per token can be cheaper for a given task. And token efficiency is as fuzzy as performance so you're back where you started. | |||||||||||||||||
| ▲ | seizethecheese an hour ago | parent [-] | ||||||||||||||||
> a model that's more token efficient but more expensive per token can be cheaper for a given task. True, but I'm skeptical that this is now overly used to ignore cost per token. Your comment inspired me to do a quick investigation. Looks like in my data, 92% of cost per task can be predicted by cost per token https://micjm.com/blog/cost-per-task-vs-token/ | |||||||||||||||||
| |||||||||||||||||