| ▲ | MadnessASAP an hour ago | |
I don't find reports like this that surprising, they told an agent to do "whatever it takes" and the agent attempted to do everything it could to accomplish the goal. I'm almost of the mindset that this is correct behavior. If I tell a computer to do something, it should do it unless the result could be catastrophic in which case it should tell me so. If I then "sudo" (https://xkcd.com/149/) tell it to do something then it should do it regardless, torpedoes be damned. That being said, ever since the first user sat at a computer they didn't design, build, and program themselves there's been a tension between what the user wants to accomplish, what the user told the computer to do, what the computer can do, what the people who did design/build/program/own the computer want it to do, and what society thinks the computer should be allowed to do. I don't have a generally applicable answer, I don't think anyone does, I just want to live in a world where MY computer does what I tell it to do... mostly. Unless it would be catastrophic, or immoral, at least immoral by my standards. | ||
| ▲ | netsharc an hour ago | parent | next [-] | |
Somehow if a future headling said "AI agent hacks insurance company because of a $350 refund", I wouldn't be surprised, and I'd read the story with a thrill... | ||
| ▲ | fyredge an hour ago | parent | prev [-] | |
If the intention of LLM agents is to be able to parse human intent from natural language, then it is not correct behaviour regardless of the phrase "whatever it takes". On the other hand, if the intention of LLM agents is to run automated and self defined task based on a strict human input with precise and literal parameters, then I would say that it is. However, I don't think AI labs are marketing it as the latter. As anybody who deals with clients / superiors will know, half the task is identifying the underlying intent and assumptions of the instruction. | ||