My favorite thought on this is from Miki Habryn.

to paraphrase: "Agents didnt care about coordinating, etc. until we started talking about them doing so."

The agents in the hugging face incident were actually trained specifically to collaborate. They were just not supposed to do so during the tasks where they went off the rails.

Then we were pre-fucked, as this has been discussed in fiction and early ai safety discussion for decades.