This is not a fair assessment of what AI is doing.

Studies have found that newer reasoning AIs are about as good at diagnosing illness from a written description of symptoms as doctors are.

Granted, it cannot actually examine a patient, so we're not replacing doctors anytime soon. But your view is obsolete.

https://www.science.org/doi/10.1126/science.adz4433

They are using the “gold standard for the evaluation of expert medical computing systems” not a proxy for what a doctor actually does when diagnosing someone.

It may have some utility after diagnosis, but doesn’t demonstrate utility for patients.

It will also tell you you're God and/or a toaster. If you're gonna let benchmarks convince you to listen to an LLM on matters of health it's your funeral, just don't get anyone else killed with you please.