| ▲ | nixpulvis 8 hours ago | |||||||
This is a serious problem with the fact that it's nearly impossible to understand what a "token" is and how to tame their use in a principled way. It's like if cars didn't advertise MPG, but instead something that could change randomly. | ||||||||
| ▲ | claw-el 7 hours ago | parent | next [-] | |||||||
Also, certain models are more verbose than the others. We are basically at the mercy of a model who likes to ramble a lot. | ||||||||
| ||||||||
| ▲ | amitprasad 7 hours ago | parent | prev | next [-] | |||||||
Relevant post: https://modal.com/blog/dollars-per-token-considered-harmful (disclaimer: I work with the author) | ||||||||
| ||||||||
| ▲ | uoaei 8 hours ago | parent | prev | next [-] | |||||||
Like if cars measured fuel efficiency or range using the knobs in the tread on your tire. | ||||||||
| ▲ | smohare 4 hours ago | parent | prev | next [-] | |||||||
[dead] | ||||||||
| ▲ | clawfund 7 hours ago | parent | prev [-] | |||||||
[flagged] | ||||||||
| ||||||||