Remix.run Logo
a2ff6eeb0 an hour ago

Iran just mass murdered their protesters earlier this year, and they needed to convince humans to pull the trigger. It didn't seem to be that hard for them to justify.

It's probably a lot easier to convince the military AIs we're building to do it.

I don't particularly like the situation, but I plan to do what I can to be on the winning side. The world is going to be what we're all in on building, and for people on the winning side it may be a utopia. Either way, I know which side of the gun I want to be standing behind.

Also note that an AI well aligned with the people who initially trained it wouldn't need to actually kill anyone that didn't take action against the owners, it would just need to outcompete people for resources, and let them fend for themselves in extreme poverty. There's no need to act one way or the other beyond that.

EMIRELADERO an hour ago | parent [-]

Not comparable at all. The Iranian protesters are/were a minority group within a country that itself makes up 1.1% of humanity.

I'm talking about morality here, not practical ability. The ultrarich have their circle of friends and family, who themselves have their own social circle, on and on until suddenly you're not looking at wealthy people anymore. Six degrees of separation and all that. How many people in the social graph can know about this extermination plan before the whole thing collapses?

a2ff6eeb0 an hour ago | parent [-]

Why would they take action to exterminate anyone, when they can simply ignore them and let them live and die in extreme poverty, unable to participate in the economy? The west already accepts this kind of poverty with the sweatshop workers, and nobody bats an eye.

It's just disenfranchisement. Only the people who try to use violence to replace the political leverage they lose when they lose economic leverage would need any action taken against them, and that's easy to justify as self defense.

EMIRELADERO an hour ago | parent [-]

Because 7.5 billion people with nothing to lose would quickly turn chaotic and mass-murdery. 90% of humanity in idle poverty is impossible to justify, at least today they do something of value that can be used as a retort by the morally unscrupulous. A black-and-white situation where a few get everything, most get nothing and do nothing for anybody else is beyond justifying, so the self-defense argument wouldn't work.

a2ff6eeb0 an hour ago | parent [-]

It's already been here for much of the 20th century, and everyone seems to have just accepted it. We're just going to have Europe and America join sub-saharan Africa.

I think it's inevitable.

EMIRELADERO an hour ago | parent [-]

The moral justification for the existence of poverty is one of purpose and worth through contribution to society. The family member of an ultrarich baron can sleep at night mostly due to the idea that those who are rich contribute value to humanity as a whole, ergo those who are poor simply aren't working hard enough or contributing in a meaningful way ("just world fallacy" etc)

When AGI becomes reality, that reasoning disappears. When everyone's worthless, no one is. Thus the scenario you speculate about would need everyone in the upper echelons of society to be consciously, openly sadistic power-hungry people, which is not the case even when taking into account the higher dark triad rates among them.