I've stopped calling out Claude mistakes on team meetings because this is so true.

I mean, sure, I could have predicted in what ways an LLM would fuck up, but there's just so many ways I can't keep up.

We just had a major production issue because someone's LLM wrote queries against dev databases. Which are very obviously dev databases because they are labelled with dev in the name, and in the table descriptions. AI reviewer didn't catch it, neither did the human reviewer for that matter.

someone's LLM wrote queries against dev databases... AI reviewer didn't catch it, neither did the human reviewer