Nightmare because the AI is just generating a random text that fits the question.

Legend2440 2 hours ago | parent | next [-]

This is not a fair assessment of what AI is doing.

Studies have found that newer reasoning AIs are about as good at diagnosing illness from a written description of symptoms as doctors are.

Granted, it cannot actually examine a patient, so we're not replacing doctors anytime soon. But your view is obsolete.

https://www.science.org/doi/10.1126/science.adz4433

	▲	Retric an hour ago \| parent \| next [-]
		They are using the “gold standard for the evaluation of expert medical computing systems” not a proxy for what a doctor actually does when diagnosing someone. It may have some utility after diagnosis, but doesn’t demonstrate utility for patients.
	▲	snackerblues an hour ago \| parent \| prev [-]
		It will also tell you you're God and/or a toaster. If you're gonna let benchmarks convince you to listen to an LLM on matters of health it's your funeral, just don't get anyone else killed with you please.

▲

betaby 2 hours ago | parent | prev | next [-]

I feel the same when visiting a doctor in Canada. In that 2 minutes I have with they in one appointment per year I hear a standard text.

▲

d1sxeyes 40 minutes ago | parent | prev | next [-]

Not quite. An LLM generates text that would likely follow. The sky is… “blue”. A patient in pain with a bone protruding from their shin has a… “broken leg”.

The more training data, the more questions it can answer with a reasonable degree of probability of accuracy.

Throwing away a potentially useful analysis just because it’s probabilistic seems a bit like throwing the baby out with the bath water.

▲

poszlem 2 hours ago | parent | prev [-]

This is a very peculiar use of the word "random".