Remix.run Logo
PowerElectronix an hour ago

I fail to see how a machine that can hack everything can't also patch everything and make the system unhackable.

A nuke, a virus, whatever... The knowledge is nonlonger the bottleneck, it's the tools and materials.

Also, I'm extremely skeptical about AI becoming even close to a child in intelligence.

darnfish 32 minutes ago | parent | next [-]

If you are attacking a system, you can try 100 things. If one thing works in getting access, you succeed.

If you are defending a system, you must defend against all 100 things. If one thing makes it through, you lose.

frabcus an hour ago | parent | prev | next [-]

Yes - this is why the concern is one for "alignment". Of course in theory it is possible for intelligence to help and do good things - the hard part is making sure that that is what happens.

As for intelligence of a child... It doesn't need to be a child. An aeroplane isn't a baby bird.

imhoguy an hour ago | parent | prev | next [-]

"patch everything" - there is no such way in the Universe unless you reduce "everything" complexity to just one electron. The higher the complexity the higher the surface of messing things.

frotaur 40 minutes ago | parent | prev [-]

There is no intrinsic physical reason that the difficulty of 'defending' a system is symmetric with the difficulty of 'attacking' it.

For instance, it is not because you are able to design and release a (biological) virus that you are also able to defend from it (design a vaccine and inoculate the world's population).

If we're lucky, it might be the case for many instances of problems, but there is no a priori guarantee that this holds.