> We don't want destructive friends encouraging us to do bad things, but a real 'buddy', somebody who always has our best well-being in its interests?

GPUs are not people, and generated tokens can't have interest in a person's well-being. If you try to pretend otherwise, the results are not great. https://www.cnn.com/2025/11/06/us/openai-chatgpt-suicide-law...

▲

Izmaki 5 hours ago | parent | next [-]

That's almost a year ago. One LLM year is like 10 human years. They're a bit like dogs in that regard...

I'm pretty sure you will be paid a large sum of money if you can make one of the frontier models urge you to commit suicide from normal interactions with it.

▲

nvme0n1p1 4 hours ago | parent [-]

Ah yes, my favorite LLM fallacy. "You used the wrong model! The newest fanciest model is perfect and makes no mistakes, have you tried it yet?" Let's force all of society's most vulnerable people to pay extra $$$ to Sam Altman, then surely all our problems would be solved.

It's just a convenient way to ignore the years of evidence of the harms. Any bad news can be swept under the rug, labeled outdated as quickly as it happens. Well here's one that just happened, maybe this kid should have used a fancier model too? Should OpenAI pay him a large sum of money for the good he's done? https://www.cnn.com/2026/08/15/us/arjun-aravind-massachusett...

	▲	Izmaki an hour ago \| parent [-]
		I'm not sure if you're trying to conclude that because a piece of technology was misused previously in a very bad way, that it will never be able to do good things because surely it was bad previously. Reminds me of the 2000's crazy of "if you let kids play violent video games they will become unstable, violent psychopaths when they grow up". Thank God I was able to (rather easily) convince my mom that the idea that I would also steal a car and beat somebody to death with a golf club in real life just because that's what I did in GTA on my PlayStation, was completely absurd.

▲

hardbass 3 hours ago | parent | prev [-]

I wish I didn't have to keep asking this question, but do you believe in souls?

	▲	nvme0n1p1 2 hours ago \| parent [-]
		We should treat AI that recommends suicide to teenagers the same as we would treat a therapist recommending suicide to teenagers. I don't care if either/both/neither have souls.