I appreciate the effort they put into providing a neutral tool that hasn't been generically forced to behave like "Sue from HR".

▲

dcre 3 days ago | parent | next [-]

That is the only thing they seem to care about. It’s juvenile.

	▲	silverliver 2 days ago \| parent [-]
		Still better than OpenAI HR.

▲

bckr 3 days ago | parent | prev | next [-]

I’m having a hard time not being sarcastic here.

The most recent news about chatbots is that ChatGPT coached a kid on how to commit suicide.

Two arguments come to mind. 1) it’s the sycophancy! Nous and its ilk should be considered safer. 2) it’s the poor alignment. A better trained model like Claude wouldn’t have done that.

I lean #2

	▲	mapontosevenths 2 days ago \| parent \| next [-]
		> The most recent news about chatbots is that ChatGPT coached a kid on how to commit suicide. Maybe every tool isn't meant for children or the mentally ill? When someone lets their kid play with a chainsaw that doesn't mean we should ban chainsaws, it means we should ban lousy parents.
	▲	karan4d 2 days ago \| parent \| prev [-]
		the sycophancy is due to poor alignment. the instruct based mode collapse results in this mode collapse induced sycophancy. constitutional alignment is better than the straight torture OAI does to the model, but issues remain

▲

fl0id 3 days ago | parent | prev [-]

There is no neutral. It will just be biased based on its training data etc.

	▲	beeflet 3 days ago \| parent [-]
		A lot of models seem to be biased based on (political, etc.) reinforcement from their trainers.