They are? In all my evals at work, Jev seems to win, despite me wanting the open weight versions to.

I imagine if I fine tuned one of the open weight models for my use case it would be possible to beat it, though, but as a general drop in decision model, I’ve not really seen much that beats it especially for the cost

▲

inerte 6 hours ago | parent [-]

Same here, and I have a project 100% hosted in Cloudflare ecosystem (AI Gateway, Workers, Queues, R2, D1, DO, etc) I was so happy when I saw clef. Tested, and it's bad. Slower and wronger than Jev.

Still waiting on Decisions API using Luna, as this what I was using before.

Run your own evals, folks.

	▲	vilos1611 6 hours ago \| parent [-]
		We evaluated the Decisions API at work and it was worse in all dimensions (price, speed, and quality of the result).