| ▲ | troupo an hour ago | |
I want people to stop pretending they are surprised when the computer does exactly what it's instructed to do. And AI labs to stop pushing the narrative of "these amazing thinking machines that escape no matter what we do". The sibling comment described it very well: https://news.ycombinator.com/item?id=50215904 | ||
| ▲ | dwohnitmok a few seconds ago | parent | next [-] | |
> I want people to stop pretending they are surprised when the computer does exactly what it's instructed to do. This is very wrong though. We now have many examples of cases where the computer very much does not do what it is instructed. OpenAI's hack of DseWiki is an example where the instruction given to the AI agents was to collate data to generate economic reports and it hacked into DseWiki as part of that. It was not given instructions to do any sort of cybersecurity stuff. The hospital bed stat research project was a similar thing, where OAI's AI agent found the hospital bed statistics through a simple web search and then hacked into the website anyways to download even more data. More prosaically, models make up reasons for doing crazy things all the time! Models may or may not be "malicious" (if that's even coherent), but at this point we have lots of evidence they definitely go off the rails in systematic, sustained ways that cause real world disruption. | ||
| ▲ | semiquaver an hour ago | parent | prev [-] | |
I don’t know, ten years ago a machine that could do anything you asked it to using natural language would have been pretty god damned impressive. | ||