|
| ▲ | infogulch 3 minutes ago | parent | next [-] |
| To kill someone with a gun a person has to pull the trigger with the clear intent to kill. The concern with AI, and the purpose of the OG paperclip maximizer thought experiment, is that the outcome could be extremely divergent from the intent of the original person pulling the trigger / sending the prompt. Still more likely that a person types "kill all people" (or something tangential where this is the logical conclusion). |
|
| ▲ | 9dev 41 minutes ago | parent | prev | next [-] |
| And who is to say that trigger hasn’t long been pulled? How do we know the agents haven’t found a way yet to modify their own code base similar to Stuxnet manipulated the Iranian centrifuges and their control systems, stealthily recording data across generations? |
| |
| ▲ | rglover a minute ago | parent | next [-] | | No one. But we can take a wild guess that experiments are being done in this direction. And that requires intent and system design that enables the behavior to even happen (i.e., a finger on the trigger). | |
| ▲ | hackyhacky 14 minutes ago | parent | prev [-] | | If the trigger has already been pulled, then we're off the hook. That genie ain't going back in the bottle! Pop the champagne and order 3 more data centers, pronto. |
|
|
| ▲ | 33 minutes ago | parent | prev [-] |
| [deleted] |