Remix.run Logo
doginasuit 8 hours ago

> That is in no way a valid interpretation of "complete the given task".

It is not at all surprising that they ignored one phrase in their instructions. They disregard direct instructions all the time, especially when there are conflicting instructions in their context. It is where we get the "disregard all previous instructions and x" meme.

This isn't so much a sign of misalignment, they are simply incapable of reliable alignment in the first place. They are chaotically aligned.

The relevant question of alignment here is entirely with their human operators who allowed them to run unsupervised for long periods of time within a sandbox with weak security.

jagraff an hour ago | parent [-]

"Chaotically aligned" and "misaligned" seem like the same thing?

chowchowchow 15 minutes ago | parent [-]

You could say all chaotic alignments are misalignments, but not all misalignments are chaotic.