This is why it's going to be a long time before companies will trust AI to scan their networks or apps for security vulnerabilities.

Our company audited a few AI-based pentesting companies and requested logs. In more than one case, it was sending drop tables for sql query injection checking and other destructive operations.