Remix.run Logo
▲ vanuatu an hour ago

An aligned AGI (or ASI) would construct a world far more just and abundant than what we currently have.

▲atleastoptimal an hour ago | parent | next [-]

It could construct a world far more just and abundant. It would have thousands of options of what to do with the universe, trusting that it will spend time space and energy creating a human utopia is a matter of faith

▲vanuatu an hour ago | parent [-]

hence the alignment problem

▲atleastoptimal 8 minutes ago | parent [-]

The problem with alignment is it is an idea based on the definition of its specification, which says nothing about the form it will take.

It’s similar to the No True Scotsman fallacy: any bad outcome due to AI could be dismissed as “well no aligned AI would do that”. Alignment becomes an asymptotic north star which very well could be theoretically impossible, but would be impossible to know whether it was.

▲sl-1 an hour ago | parent | prev [-]

If we would have any idea about how aligment works.

I'd argue we can't align humans to neccessarily degree to ensure even semi stable future. Or nations, or corporations.