Remix.run Logo
▲ kypro 17 minutes ago

If I were to guess it's because a model trained purely on maths wouldn't be as likely to create such diverse and deep layers of abstractions as it would need to if it were being trained to predict something as complex as the real world.

A maths model trained only on maths would only learn how to predict something if a pattern was exposed often enough and was a useful enough predictive signal. While I'm sure it could all the same patterns and abstractions with a maths dataset alone, it would depend far more on that dataset being exceptionally well designed.

As an example imagine a self-driving car. A self-driving car needs to understand road signage. You could train a self-driving car with all of the signs in the US and I'd suggest that it wouldn't be as good at predicting signs in the real-world as an AI which in addition to being trained on road signs, could also read text and understands material science. Why? Because in the real world signs can be damaged and distorted. An AI that could understand the ways in which signs might distort and can understand that a four letter word beginning with an S and ending P is probably "STOP" even the T and O are ineligible. Of course, an AI with a rich enough dataset containing damaged signs might eventually get equally as good, but perhaps would never quite understand the patterns that underlie the patterns - it would recognise all of the way a stop sign can be damaged and distort, but not why the distortion happens or what the letters on the sign are and how they relate.