Don’t cars and ropes and drills occasionally kill people too? Society seems to have accepted that fact long ago.

Somehow we expect the digital world to be devoid of risks.

Cryptography that only the good guys can crack is another example of this mindset.

Now I’m not saying ClosedAI look good on this, their safety layer clearly failed and the sycophantic BS did not help.

But I reckon this kind of failure more will always exist in LLMs. Society will have to learn this just like we learned cars are dangerous.

Another great example of the HN mindset. How can you say "their safety layer clearly failed" without being able to acknowledge that they should be held responsible for that failure and that we should work to reduce the likelihood of similar failures in the future? If a car, rope, or drill had some sort of failure in their manufacturing that killed people, those companies would be held responsible. Why can't we do the same with OpenAI?

This isn't a desire for "the digital world to be devoid of risks", it is a desire for people and companies in the digital world to be held responsible for the harm they are causing. Yet, people here seem to believe that no one should ever be held responsible for the damage caused by the software they create.

Cars and ropes don't "talk" and don't make an impression of a human being.