| ▲ | alex7o an hour ago | |
Even jev is not truly novel, but it's latency is, you can use a reranker and get the same things but not the same speed. | ||
| ▲ | Foobar8568 6 minutes ago | parent [-] | |
Well, according to claude and Jevbench, Qwen 3.6 35b with ninfer on a RTX 5090@480W is like 3-5 time slower but 10%-15% better performance on the public set, I could see prefill > 15k for 700-800decode. Latency against what and which hardware? I don't really get jev... | ||