Remix.run Logo
▲ pegasus 5 hours ago

That's an incorrect interpretation of what that mathematician said, which was in fact the opposite: the models have such power of computation that they can just brute-force a problem without needing to climb a ladder of abstraction. Which explains why the Lean proof to the GRH is 200k page and about 17 million lines long.

Here's an in-depth explanation from Gemini Neon: https://share.gemini.google/lPWabl6Goaxc

The question is, do the models actually understand what they are doing? I would say no, though they can be used to understand the proof later. They are just blindly tunneling through the state space and brute-forcing their way to the solution. With some very unwanted side-effects on the environment to boot.

▲hardbass 2 hours ago | parent | next [-]

Here is the supposed quote from the mathematician in the chat linked above btw:

"Incidentally, when I say that the math(s) dump 'does not appear to be strong on exposition', all I mean is that I, as a human expert in this field, have difficulty understanding it... But as far as Fable seems to be concerned, the exposition in [TC26a] is perfectly clear. So perhaps the problem is not with the exposition, but with us humans. ... Perhaps we need to ask the LLMs to 'explain it to me like I'm human' (ELIH)."

"pegasus"'s full prompt was (minus the hyphen line separators which I added):

----------------------------------------------------------------------------------

I came across this paraphrased quote today: "I was reading a mathematician's take on a recent OpenAI proof (their area of expertise). They argued that models don't lack theory building, they just work at such a high level of abstraction that they don't need it.", which is said to come from this article: https://web.maths.unsw.edu.au/~davidharvey/research/subnlogn...

Read the article and explain this further. My question is: isn't a mathematical theory just that—a higher level of abstraction?

----------------------------------------------------------------------------

I leave it to the reader to think how this statement is the "opposite", and to think what "merely" a higher level of abstraction entails with respect to a thinker's abilities to work such concepts out.

▲hardbass 2 hours ago | parent | prev [-]

If brute force is so easy, why aren't you able to do the same without AI just writing the brute force solver yourself?