Im not saying it cant do those things. The mathematical equivalent of that are the hundred proofs that OpenAI dumped. And probably we still have a few decades of AI exploiting low hanging fruit in Maths and Art.
I was refering to going beyond and deciding what to explore. There are infinite paths in mathematics and a lot of ways you can describe and denote a particular theory. And the choice of notation and exposition is an art in some way.
You could probably say that "no, but this is done by minimizing memory usage in human brains so that its understandable by humans, maximizing compressability of previous ideas, and a link with some utility in the real world, etc"
But that just one example of loss function. There are many possible ones.
Do i think that there is a universal loss function that captures it all? Probably yes, in the limit, on the infinite energy regime. Are we in that case in practice? Probably not.
I tend to think that AI will fully replace us the same moment we are able to master prime factorization with our time and energy constraints.
