|
| ▲ | DennisP a day ago | parent | next [-] |
| Since these are massive neural networks trained to imitate human behavior, I'm not convinced anthropomorphic descriptions of their behavior are inappropriate. And that's even though I don't think they internally experience "feelings, desires, and wants." They do have goal-seeking behavior, because we trained them that way. Calling it a "want" just saves syllables. None of this means human culpability should change. People in these companies know what risks they're taking. |
| |
| ▲ | reasonableklout a day ago | parent [-] | | For sure, Zvi has a good section on all the human failures at OpenAI in this incident here: https://thezvi.wordpress.com/2026/08/29/metr-and-redwood-off... Dwarkesh responds a bit to anthropomorphization. I think it would be great if he talked more about the human factors behind this incident but pretty much he doesn't cover it because that's not what the Ajeya interview was about: https://www.dwarkesh.com/p/ajeya-cotra?r=3i6mn2&selection=77... I think the reality is that these human failures are going to keep happening until there is industry regulation. This is the most competitive industry we've ever seen and there is intense pressure to build as fast as possible. I'd hope that this incident is a big enough moment to push for it. |
|
|
| ▲ | felipeerias a day ago | parent | prev | next [-] |
| We don’t need to assume consciousness or anything like that. The models autocomplete narratives. In this case, one where a group of individuals, faced with an impossible task and a looming Evaluator, gang together and begin trying any idea that they can come up with in order to pass the test. |
| |
|
| ▲ | huurtehoog a day ago | parent | prev | next [-] |
| "My car went rogue, I put a brick in my car's accelerator pedal and jumped off and it cause a massive pile up" Please |
| |
| ▲ | estearum a day ago | parent [-] | | If cars were designed to and actually did produce massive value when you put bricks on the accelerator pedals and jumped out of them, this would be a big big problem. | | |
| ▲ | huurtehoog a day ago | parent [-] | | Is the massive value being created by LLMs in the room with us right now? | | |
| ▲ | estearum a day ago | parent [-] | | You can go ahead and assume that it's not. All that's necessary is for other people to think there is and to therefore continue to pile resources into these things while connecting them to more systems. Now you can respond to the substance, please. I'll tee it back up for you: > If all the world's richest individuals and corporations believed cars produced massive value when you put bricks on the accelerator pedals and jumped out of them, this would be a big big problem. |
|
|
|
|
| ▲ | WarmWash a day ago | parent | prev | next [-] |
| While his battleship was blown apart and sinking, the captain proclaimed "How is this possible?! Submarines can't swim!!" |
| |
| ▲ | bbor a day ago | parent [-] | | Ha! Never thought I'd see a new twist on that old of a favorite. Chomsky would be thrilled. |
|
|
| ▲ | jbs789 a day ago | parent | prev [-] |
| What scares me is the thought his nonsense is common sense within some circles. |
| |
| ▲ | emp17344 a day ago | parent | next [-] | | Circles like HN? Seems like a lot of folks here bought into it in the thread discussing the article. | | |
| ▲ | jbs789 a day ago | parent [-] | | Time will tell.
Did you know that when bicycles were invented society was concerned about the moral corruption of children and women? Who knows where they will go without men! The anthropomorphising is also a head scratcher for me. Ancient civilisations explained the weather with gods. We are doing the same here, explaining the unknown by assuming there is some being/consciousness. |
| |
| ▲ | gwerbin a day ago | parent | prev [-] | | Forget common sense, he is a trusted figure by many, so if he says something wrong or nonsensical, people are going to believe it as long as it's engaging. If he's willing to abuse the trust of his audience and lie and mislead people, that he's no better than Alex Jones, Rush Limbaugh, or Joe Rogan. |
|