I think the reason I am surprised is that they are exceptionally good at interpreting images generally and there are tens of thousands of labeled skin cancer images on the public internet so I had assumed the general image interpretation abilities would transfer

The specialized medical diagnosis models are trained on that same data though, and also use neural networks. The more noteworthy story will be when they overtake specialized models.