> we are just a couple of steps from the possibility of a true rogue AI

No no. We are not a couple of steps away. This is happening. AI is already used for hacking and creating a harness that makes this fully autonomous is relatively straightforward.

▲

RandomLensman 2 hours ago | parent [-]

How would that be rogue?

▲

_pdp_ 2 hours ago | parent [-]

I might have a different definition of "rogue" but to me it means when you go outside of the rules/norms ... and this is happening all the time.

▲

RandomLensman 2 hours ago | parent [-]

I see. I would have thought of "rogue" here to mean something more like that the AI selects and acts on its own objectives that are not related or caused by the given (initial) objectives (e.g., creating only cookie recipes instead of any hacking).

▲

simonh an hour ago | parent | next [-]

That’s what the alignment problem is all about though, isn’t it? AIs always act towards ‘their own’ objectives, that they derive from our instructions.

What we try to do is train them and provide instructions that will result in it having an objective closely aligned to our objective.

	▲	RandomLensman an hour ago \| parent [-]
		What "own objectives"? Isn't it more that specifying objectives is hard (AI or organic) and typically supplement them by boxing things in (again, AI or organic).

▲

_pdp_ an hour ago | parent | prev [-]

Well if the recipe requires access to some secret ingredient it may as well resort to hacking to obtain it. ;)