The more likely AI becomes to produce working code every time, the more likely it will become that a one-in-a-thousand or one-in-a-million error goes unnoticed at generation time. It sucks.

Bugs have existed since before AI, though. It's remarkable how bad a lot of very successful software has always been.

Sure, but we currently find that acceptable. Codebases are full of such bugs.