I don’t know how you quantify a very low p(doom), but this is why mine is high enough to worry me.

A million AI monkeys at a million AI typewriters, banging away at random, could do amazing damage.

tharkun__ 4 hours ago | parent | next [-]

Especially when they cross into the physical realm as in not properly secured and air gapped control systems. SCADA is scary.

▲

mrob 4 hours ago | parent [-]

That lowers P(doom), because it gives AI a chance to do enough damage to make people take the threat seriously before anybody gets recursive self-improvement working.

	▲	doginasuit 4 hours ago \| parent [-]
		Exactly, there's no path to AI reaching that level of dominance without taking actions with high stakes.

▲

otterley 2 hours ago | parent | prev [-]

Which will happen first: amazing damage, or reproduce a Shakespeare play?

	▲	AnimalMuppet an hour ago \| parent [-]
		It is easier to destroy than to build.