I would argue that we are seeing a new emerging group of coders come into the realm of programming and we are judging them at their worst and comparing them to our best

    It is quite insane to me to expect someone who just started to fully build google.com and all of it's infra,security,etc.

Look, I've been using Claude and Codex agents for about 6 months now, full time for coding (when I code) essentially (coz I can't ask my people to use a tool I have no experience with myself, so I purposefully forced myself to use the agent and only the agents as much as I could bear, only resolving to manual changes in very very few instances. And there have been many many frustrations, believe me).

The amount of times that even Seniors have just verbatim pasted Claude analyses as truth to me, when it was apparent after the first read through of the output, that it wasn't true is amazing. How we expect juniors that have way less developed "spidey senses" to successfully navigate that is beyond me. Most people are trusting by default. They shouldn't be, but it's human nature for most of us. For some it isn't, like myself. I'm already the dude that asks too many questions of humans when they're not clear on what they assumed vs. have verified.

Like, example, I showed an analysis, full page in a slack thread recently to one of my Seniors (made by some other Senior) and tell me where they think it shows that it's BS and not true. He couldn't do it. He tried over and over and he was unable to. I read it and the second paragraph out of lots of them was BS and just not true. Easy to verify. Claude didn't have access to the actual information (because of various circumstances) but just made something up. Said the relevant code was deployed, thus XYZ was true. Listed lots of extra analysis after that, which sounded reasonable and probably was, if the premise was correct. Just it wasn't. The code had never been released at that point.

I've been doing the same kind of "spidey senses are tingling" comments and questions back to people for lots and lots of years. And others are usually not good with that sort of thing (exceptions prove the rule). Coz people do the same kind of "BS-ing" that Claude et. al. do. Claude is generally "better" about questioning his/her (yes, it works both ways) judgement actually than people, which in many cases have feelings attached to their investigations (even if they very blatantly didn't check something and just assumed it - pre AI - all by themselves).