This has been going on since people have been committing AWS keys to GitHub and is nothing new. You could famously commit some keys and then have crypto miners in your account in 5 minutes.

Sure the AI can translate “exploit this” into an exploit but that doesn’t change anything at a fundamental level.