Remix.run Logo
▲ vulture916 an hour ago

Jev = $0.042/m input, output free Clef = $0.24/m input, no output price listed

At 300 tokens per call, you'd get:

One million decisions on Jev cost about $12.60. One million decisions on Clef cost about $72.

Would probably make sense to self-host Clef, if you have the capability/resources. If not...

▲scronkfinkle 38 minutes ago | parent | next [-]

> no output price listed

It's weird to think of these kinds of models as having "output tokens". Cross-encoder approaches like Laya add a [MASK] marker per option, but nothing is generated the way an autoregressive transformer generates. It's one bidirectional pass over your input, then a small head scores each option, so you wouldn't really pay for output as much as only input

▲jampekka an hour ago | parent | prev [-]

Output for decisions have so few output items (not really tokens here) that they are negligible anyway. Jev hyping "free output" is almost lying by omission.