This is really a microcosm of one particular problem that AI presents to the world: what do people do when their labour is not required any longer?

Here the worry is the social structures of mathematics are eroded such that fewer humans become able to do the work and less well, similarly to how juniors are being recruited less in software engineering, breaking the ladder and leading to fewer seniors in the years to come.

The answer to this really depends strongly on what AI can actually accomplish, but I’ll assume the maximal case and say that AI can do everything economically necessary, and further even those things just desired, such that human labour isn’t required for anything that anyone wants in a practical sense.

Here, we don’t need a human understanding of mathematics to give people a perfect standard of living. We also don’t need humans involved with anything else.

Everything therefore becomes a hobby or a game. People do things because they enjoy them for their own sake, or because they are endeavours used as vehicles to socialise and enjoy others’ company, or because a shared social belief exists and is cultivated such that doing such and such a thing confers social status.

And I think that’s more or less it. I predict we may see some fairly strange sorts of things, such as games where the team structure looks like the descendant of a company org and they compete in an artificial economy. Likewise we may see gamified versions of universities and academia. All of these would be “tamed” such that the rougher parts of the experiences were sanded off.

Sort of like how we evolved in an ancestral environment, and we have certain drives and expectations driven by that environment even though they no longer matter for survival. Our social structures may be derived similarly from those of today, even after they have ceased to serve a real purpose, but changed and repurposed to give meaning and community.

> what do people do when their labour is not required any longer

I don't think this is the main issue (if at all) discussed here or in the field medalist letter. If anything, the majority of pure mathematics graduates are absorbed from the industry and a lot of exodus happens along the different scales of academia to there (though industry is also dealing with this issue but that's not what's concerned here). The issue discussed is what mathematics itself will be, which is much deeper. AI finding proofs to open problems does not solve at all the question of how to produce new problems, and there is no indication imo that there is way to go with that with AI.

Pure mathematics is not like applied sciences, as it is only tangentially influenced by external applications. Deciding which problems to tackle is a social process and a matter of taste/aesthetics, and is built largely through the exact friction that is more and more removed with AI. This is what makes it unclear how one can find problems without this friction, and none of these posts/letters have an answer really. Each one seems to describe just different standpoints than concrete, practical ideas.

Kinda relevant here: https://jonnegroni.com/2015/04/15/the-humans-of-wall-e-were-... I kinda expect/hope for something like this myself (minus being fat, GLP-1s have that taken care of now, so a future of fat people seems unlikely heh)

I somewhat disagree. we still need humans to provide direction and context and expanded the concept of... well everything. But we will certainly need less of them. AI will afford the ability to more quickly disseminate state-of-the-art. As soon as a breakthrough is discovered, you no longer need to read 300 whitepapers to hopefully stumble upon it, AI will identify relevancy quicker.

AI didnt break through stavier-nokes until a human set the initial direction. That's not going to change.

>Everything therefore becomes a hobby or a game.

Already predicted. How much Whuffie you got?

https://www.gutenberg.org/ebooks/8086

> that AI can do everything economically necessary

Who gets to define this? Those with power are famously bad at understanding long-term implications, how things work, and what matters - especially when it comes to funding things like research.

I agree with your argument of expected societal shift, but it's important to keep in mind that this is largely a developed country issue. It'll be a while before child-staffed cobalt mines or whatever is superseded. A significant amount of poverty could be alleviated through improved resource distribution and policy, without really needing improved productivity/increased resource production.

The Machine Stops by E. M. Forester is basically this world.

Did you even read the open letter? Mathematicians are annoyed because the proof is only meaningful if people understand it and came to it. I mean I’m basically just summarising it now but it’s annoying you didn’t read it or can’t comprehend its nuance.

"And maybe I could have tried to gain that respect in a different way, such as thinking very hard about an area of mathematics until I was able to demonstrate to others just how well I understood it. But I’m not sure how motivating that would have been for me. I very much hope that there is a pool of young people for whom it will be a powerful motivation, because I think the survival of a human mathematical tradition may well depend on it. [...] Thus, the primary risk, as I see it, is that a lot of people who would have done a PhD in mathematics and gone on to become custodians of the mathematical tradition will no longer wish to do so. Those of us who have PhD students, including me, need to try as hard as we can to come up with imaginative ways for them to use their time productively (in consultation with the students themselves, obviously)."

When I read this I'm trmpted to read "imaginary" instead of imaginative - that is: in the sense lacanian psychoanalysis uses the term imaginary in contrast to symbolic - the latter of which would mean that it's having consequences within the symbolic social order. From their own, quite selfhonest evaluation the author assumes that without those they would most likely not have persued the mathematical profession. Which also relates to:

"A related risk is that the perception among policy-makers will be that mathematicians are no longer needed and that funding will become much harder to come by: we urgently need to come up with good ways of explaining the value of having a large pool of human mathematical experts, even if it is no longer part of their role to find new proofs of theorems."

Note that there isn't any attempt to establish a possible horizon as to how that coule happen.

It seems to me that the end of the article has a strong tendency to a somewhat stoic attitude of one might phrase as: it is going to happen anyways - the systemic context in which these corporations act makes it inevitable ("However much we might regret that, there is no chance that the impact of such models on mathematics will persuade AI companies to stop their release, though perhaps concerns about safety will lead to some delay and give us a bit more time to work out how to adapt. Assuming that they are released, there will be a flood of new results, whether we like it or not, and it will no longer be the AI companies producing them, though perhaps the pattern will continue that the AI companies will have access to more powerful models and so will obtain more than their fair share of headline results.") - which makes me kind of wonder if it is not some sort of cognitive dissonance within the authors view of the situation to not also think 'it's not going to happen' in regard to their stated requirements (students that don't need to be motivated by a desire to be symbolically valuated as explorers of the mathematical frontier, and policy makers that acknowledge the value of funding the social "production" of human mathematical experts /enable such a community through funding).

So basically they see the same problems as the authors of the letter (which they also state in their letter - their should be no room for a misrepresentation of that fact: "I felt that I could not sign the letter, despite agreeing with much of what it said. Instead, it seemed better to do what I did with the Leiden Declaration and set out my own position in a blog post. But it should be understood that by doing that I am not setting myself up as a member of some opposing camp: indeed one of my worries at the moment is that the mathematical community might become bitterly divided, something I would very much like to avoid.")

So what stays is mostly their disagreement on that conceptual understanding is more important than the solving of problems for all mathematicians. - which kind of makes the problemfield of ai in mathematics somehow more urgent, as far as I have thought it through. And I'm not really convinced that the displacement of the problem into some sort of pedagogy (and it should be appreciated that the author implicate themselves in the responsibility to establish it) instead of finding solutions in the realm of policy and regulation. Seems realistic though, that they see that as an effort unlikely to succeed in a meaningful way.

Can someone argue against that reading? Am I missing something? My conclusion as such is that not only are they not opposing the authors of the fields medalist letter, but also that their evaluation of the situation is much more dire without them giving in to resignation.

>that AI can do everything economically necessary

This is practically impossible, because the "economically necessary" things to do are never fixed but instead are in a state of constant fluctuation.

Furthermore, a chain is only strong as it's weakest link. AI alone is not sufficient to do all the "economically necessary" things. We would need vast numbers of highly advanced robots to do the rest of the work going on in the world (which is >> than the work currently done by AI). So if we restrict the definition of "economically necessary" to mean the subset of all possible tasks that we currently need to do, then we are sorely lacking in the required infrastructure. We may never get there either.

In the meantime, the labor shock knowledge workers experience could lead to large unemployment. Even those that find work doing non-knowledge work, the decrease in pay and benefits may be substantial.

I think these realities are worth understanding to help ground these pie in the sky ideas about what the future will be like. Not to be mean, but your idea of the future is basically a fantasy.

> Everything therefore becomes a hobby or a game. People do things because they enjoy them for their own sake, or because they are endeavours used as vehicles to socialise and enjoy others’ company, or because a shared social belief exists and is cultivated such that doing such and such a thing confers social status.

There is actually a big leap in logic you’re doing here that it seems you are naive to. The world looks the way it does today because human societies, businesses and individuals are fundamentally in competition with one another for scarce resources, and having more resources leads to more capacity to survive, so there is always an incentive to acquire more. If you can no longer compete, you can and will be exploited. You don’t have to look very hard, far or back in time to realize that this is what society looks like. If everyone is incapable of competing except those who can afford to run a datacenter, that will not end up in socialist utopia.

> Here, we don’t need a human understanding of mathematics to give people a perfect standard of living. We also don’t need humans involved with anything else.

> Everything therefore becomes a hobby or a game. People do things because they enjoy them for their own sake, or because they are endeavours used as vehicles to socialise and enjoy others’ company, or because a shared social belief exists and is cultivated such that doing such and such a thing confers social status.

That's true only if you manage to implement communism.

If the economy remains capitalist, it means you'll suffer. There's no pleasant future of self-driven hobbies when you've got nothing to offer the capitalists, so they have no reason to give you any money. You'll have to work hard to scrape by on scraps and meager handouts to merely survive.

And in an odd way, I wouldn't be surprised if society becomes essentially communist for the nepo babies of the wealthy; after a long, slow holocaust of the now-unnecessary working classes, the only people left will be people so rich money doesn't matter. Under capitalism, the only people who are permitted comfort without work are the wealthy.