Remix.run Logo
▲ tasuki 5 hours ago

> I compared to a 10-year old CNN and to my surprise found that this was superior.

I'm surprised he's surprised.

> A small, old, specialised network using an outdated architecture recognises skin lesions far better than two frontier LLMs.

Yes of course. A 30m params Katago network with one playout is superhuman in playing go, while frontier LLMs have over 10,000 times more parameters and aren't any good at playing go. They're good at other things (such as helping you create a network that's good at playing go).

▲jrflo 3 hours ago | parent | next [-]

A CNN is also definitely not an “outdated architecture” when it comes to image classification

▲sungam 4 hours ago | parent | prev | next [-]

I think the reason I am surprised is that they are exceptionally good at interpreting images generally and there are tens of thousands of labeled skin cancer images on the public internet so I had assumed the general image interpretation abilities would transfer

▲jrflo 3 hours ago | parent [-]

The specialized medical diagnosis models are trained on that same data though, and also use neural networks. The more noteworthy story will be when they overtake specialized models.

▲ip26 an hour ago | parent | prev [-]

such as helping you create a network that's good at playing go

This is really what’s happening right now… LLMs are excellent computer users. Which makes one of the frontiers “amazing things computers always could have done, but we lacked the programmers to do”.

If basically anyone can train a high quality CNN for just about any purpose now, what new opportunities appear that computers can help with?