| ▲ | aabdi 5 hours ago | |||||||||||||
Contrarian take. I think everyone should use LLMs and the most expensive possible, unless they know how to run evals (both on line and off line). Yes its expensive, ugly, etc. But... I've seen enough IRL that people just create really bad evals that do not reflect real world. Then the product is just bad. Outright broken for the p90 customer. People don't know statistics. Offline Evals are hard. Sampling the entire population distribution is hard. Sampling the fat tail is harder. Online evals are big ops projects that are giant balls of death. | ||||||||||||||
| ▲ | abhgh 4 hours ago | parent | next [-] | |||||||||||||
Maybe I should write up a post about this, but about evals ... I have feelings. Yes you're right that writing evals is hard. And it comes down to the simple fact that the thing that you're testing - a LLM-driven feature that presumably suffers from variance and inadequate accuracy - and your measuring device - an LLM judge - suffer from the fundamental problems. But the lure of natural language is such that instead of seeing this pipeline of LLM-driven things as a path of cascading errors, it is easy to view it as one set of problems correcting for another set. In this world, the LLM-driven feature is a probabilistic entity, and the judge layered on top of that is another probabilistic entity. The real work is to look at the judge's response and infer the performance of the feature. Good evals make the inference step "pass-through", i.e., the judge outcomes have a 1:1 mapping with feature outcomes. But this kind of reliability often doesn't naturally appear. I think of reliability as being composed of three attributes: (a) consistency: do we get the same result for an eval run on the same llm with the same input (b) inter-llm agreement: do outcomes agree over multiple trials of running an eval over multiple llms with the same input (c) accuracy: does the eval agree with human judgement. You need extra work to guarantee these properties. And even when you can, you won't get 100% reliability, but say high 90s, and you still to make a judgement call as to call a feature "functional". | ||||||||||||||
| ||||||||||||||
| ▲ | mrbungie 3 hours ago | parent | prev | next [-] | |||||||||||||
If you are not getting feedback from those p90 then your bad evals are the least of your problems. Also, unless those p90 customers are bringing a big portion of your income (again, if that happens you'd KNOW that your product is broken for them) I'd not pay for the most expensive LLM to "avoid doing evals". | ||||||||||||||
| ||||||||||||||
| ▲ | dieselgate 4 hours ago | parent | prev | next [-] | |||||||||||||
Can you elaborate on what you mean by Eval? All I can think of is eval() in js... I hope you agree people should use the "right tool for the job" meaning a calculator for arithmetic rather than an LLM for everything. | ||||||||||||||
| ||||||||||||||
| ▲ | sick_of_slop 3 hours ago | parent | prev [-] | |||||||||||||
[dead] | ||||||||||||||