Which CNN? A fine-tuned version of Inception v3, fine-tuned on 68,011 dermatology images

Which LLM? GPT-6 Astra and Claude Fable 5.1, not specified exactly which version

Obviously this is a bit like comparing an 100 iq radiologist, 20 years experience, with a just-tested-at-iq-130 6 year old and observing the radiologist beat the crap out of the kid. Was anybody really expecting a different outcome? Let's see after fine tuning.

Btw: the actual lesson from that network when it came out, which is really important is that Inception v6, the Google trained version (ie. can recognize cats, halloween masks and airplanes) beat, with a wide margin, the version that was trained from scratch on clinical images (and still didn't do so well, 62%. Not even really good enough for a first triage).

You know AI companies are selling the dream that you don't even need that just-tested-at-iq-130 6 year old. They're selling the dream that an sub-average iq 6 year old can do it.

So yes, this is an important finding that LLMs are not better than experience.