Surely with all their security programs, they would run testing on the ChatGPT implementation.

I speculate that the AI didn't find this and that human effort and intuition for where to look were needed to find this vulnerability.