| ▲ | dathinab 7 hours ago | |
> I don't understand how Codex can blunder so badly. because they trust the AI too much (and seem to be fin with acting knowingly negligent) the problem is - AI tends to produces very convincing looking code, even if fully wrong - AI does mistakes of kinds no human would do, at least no human who is also able to write convincing looking code - code reviews are hard, a lot of devs, including senior devs, put a lot of implicit trust into the co-worker behaving "sane and non malicious". But AIs behave sometimes not so sane and in a way (wrt. trying to be convincing). In the worst case in ways which if it where a human you might consider to be them trying malicious sabotage the product Like a "dump" example from work: - AI randomly removes a HTML element id while doing other changes in jsx/react - the PR has a lot of changes, the id removal line looks innocent, like some on the fly cleanup - human reviewers have the bad tendency to often not look too much at deleted lines, only if they need reference to how a new line was before (but it's only a deleted line and no new line) - you don't expect humans to randomly without reason delete important properties of components when changing other things - you maybe would still have found it, but it's a emergency fix for a production issue - it happens to miss integration tests, but happens to still matter a lot for one specific important for complicated reasons not properly tested flow (similar people tend to not test logging too much, at best the presence of needed info but hardly ever the absence of noise) | ||