| ▲ | imiric 2 days ago | |
> Or, if we trust that LLMs are useful for all tasks, then it's practically useful to know what they're not good at. The thing is that there's no way to objectively measure this. Benchmarks are often gamed, and like a sibling comment mentioned, the output is not stable. Also, everyone has different criteria for what constitutes "good". To someone with little to no programming experience, LLMs would feel downright magical. Experienced programmers, or any domain expert for that matter, would be able to gauge the output quality much more accurately. Even among the experienced group, there are different levels of quality criteria. Some might be fine with overlooking certain issues, or not bother checking the output at all, while others have much higher standards of quality. The problem is when any issues that are pointed out are blamed on the user, instead of the tool. Or even worse: when the issues are acknowledged, but are excused as "this is the way these tools work."[1,2]. It's blatant gaslighting that AI companies love to promote for obvious reasons. | ||
| ▲ | rgoulter 2 days ago | parent [-] | |
> The thing is that there's no way to objectively measure this. Sure. But isn't that a bit like if someone likes VSCode, & someone likes Emacs.. the first method of comparison I'm reaching for isn't "what objective metrics do you have", so much as "how do you use it?". > > This is insulting to smart and capable engineers with many years of experience working with software. > Experienced programmers, or any domain expert for that matter, would be able to gauge the output quality much more accurately. My experience is that smart and capable engineers have varying opinions on things. -- "What their opinion is" is less interesting than "why they have the opinion". I would be surprised, though, if someone were to boast about their experience/skills, & claim they were unable to find any way to use LLMs effectively. | ||