> As a prosecutor I would argue that setting AI agents loose without sufficient safeguards is gross negligence and/or willful blindness as they are well known to escape

INAL but feel this is the approach that will be tested. It requires a defensive position which I imagine would be specific prompts or instructions to the LLM about what behavior is disallowed. If you tell it, or try to cover your basis wrt following the law, and it still does hacking behavior it’s now a question of whether you’re prompt was sufficient but you at least can say you were trying to guide it on a legal path. I think this defense would be sufficient at this point in time and probably for a few years at least.