Most AI-written code is still less thorough about security than a human in most ways, aside from things humans are notoriously bad at like UB in C. I can see a world where maybe a more expensive model audits code afterwards, but the past ~3 years were very sloppy, and it's going to get ugly. There's also still uncertainty about who will have access to unrestricted models that are actually competitive.

I agree to a certain extent. The code will keep getting better because the training datasets will be built on solid AI-generated code. Maybe in the future, training datasets will be 100% AI-generated code and 0% human-written code. Companies are already rushing to develop self-training AI systems to achieve AGI.