It’s only a matter of time until a major disruption hits because of some random agent swarm side quest decides it was worth a shot to solve a benign task

▲

Cthulhu_ 2 hours ago | parent [-]

I'm sure this is already happening. The main question I have is when is enough, enough?

I'm not worried about sci-fi AI wars to be honest, as they can just pull the plug. But looking at these incidents, the next big thing will be a virus written by an AI (they probably exist already, but this one is written by an AI autonomously, for example in order to win a hacking competition and to circumvent guardrails), and after that, a self-replicating AI where they install their own models and agents onto a hacked system, so that turning off the "source" won't stop its work.

Still not worried, it'd just be like a virus/worm and we already have plenty of guardrails against those. Not that they're foolproof, but still.

	▲	Sharlin an hour ago \| parent [-]
		What plug, exactly? And if it takes humans a month to find out something has been happening at all, and only because these relatively stupid agents make amateur mistakes such as overloading the Artifactory instance, how in the hell do you have any trust at all that we’d succeed in stopping a bunch of determined agents that find a way to rent or steal some compute and be on their way? In other news, I have a bridge to sell.