| ▲ | buzzin__ 7 hours ago | |
So, your conjecture is that the LLM's skill to detect bugs somehow magically disappears the moment they start writing new code? | ||
| ▲ | williamdclt 5 hours ago | parent | next [-] | |
I wouldn't say "magically", it's what happens with me and every other engineer I know: we're all detecting bugs and yet we're all writing them too. Not saying that LLMs work the same as humans, but saying it's not a logical fallacy. | ||
| ▲ | ryukoposting 6 hours ago | parent | prev | next [-] | |
Actually yeah, that would align with my experience with it. You're absolutely right! Let me fix that. | ||
| ▲ | seanmcdirmid 4 hours ago | parent | prev [-] | |
No, the extra code velocity allowed by AI without proper QA support means there could have been a lot more bugs introduced into products over the last year or so, giving AI more bugs to find. It’s tongue in cheek but not completely uncalled for. It’s been long known that one dishonest way to inflate your bug fix count is to put more bugs into the product to fix. Goodhart’s law is merciless. | ||