| ▲ | bicsi 3 hours ago |
| Of course it works, Jev is nothing but an API breakthrough |
|
| ▲ | dist-epoch 2 hours ago | parent [-] |
| Jev is rumored to be a 30B model, and it's input price is MUCH cheaper than similarly sized models. The maker is also heavily focused on having a profitable product, so it's unlikely to be subsidizing the cost, especially since they say they have more demand than what they can serve. |
| |
| ▲ | jampekka an hour ago | parent [-] | | You can get Gemma 4 26B A4B at the exact same token input price of $0.042/M. GPT-5 nano is not much more expensive at $0.05. https://openrouter.ai/google/gemma-4-26b-a4b-it | | |
| ▲ | bicsi 40 minutes ago | parent [-] | | Exactly, imo it’s not even that cheap if you look into perspective and consider the fact that providers could subsidize the cost of cached input tokens to virtually zero if they would allow for a more flexible API (e.g. tree of message blocks instead of chain). Most of the cost is the infrastructure around keeping KV caches, estimating their lifetimes, etc. When mist people just want to run one context block with multiple subsequent variants of a second block in parallel. I still stand by my statement. |
|
|
