| ▲ | vulture916 an hour ago | |
Jev = $0.042/m input, output free Clef = $0.24/m input, no output price listed At 300 tokens per call, you'd get: One million decisions on Jev cost about $12.60. One million decisions on Clef cost about $72. Would probably make sense to self-host Clef, if you have the capability/resources. If not... | ||
| ▲ | scronkfinkle 38 minutes ago | parent | next [-] | |
> no output price listed It's weird to think of these kinds of models as having "output tokens". Cross-encoder approaches like Laya add a [MASK] marker per option, but nothing is generated the way an autoregressive transformer generates. It's one bidirectional pass over your input, then a small head scores each option, so you wouldn't really pay for output as much as only input | ||
| ▲ | jampekka an hour ago | parent | prev [-] | |
Output for decisions have so few output items (not really tokens here) that they are negligible anyway. Jev hyping "free output" is almost lying by omission. | ||