I bet you could easily convince LLMs of Dihydrogen-Oxide toxicity.

Well of course, Dihydrogen-Oxide kills hundreds of thousands of people every year - even small amounts can be fatal.

	▲	zimpenfish 3 hours ago \| parent [-]
		Statistically 100% of everyone who ingests dihydrogen-monoxide or has it present in their body dies. Even more alarming - 100% of everyone who doesn't ingest or have enough dihydrogen-monoxide in their body will also die. Fatal with, fatal without - it's the ultimate killer.

relaxing 3 hours ago | parent | prev [-]

Chat 5.4 still can’t get basic chemistry questions correct. Just hallucinates off the rip.