Remix.run Logo
▲ stratos123 3 hours ago

I don't see anybody claiming that solving the Riemann hypothesis would be proof that current models are superintelligent. Reminder that the definition of the term is "any intellect that greatly exceeds the cognitive performance of humans in virtually all domains of interest". I do sometimes see people arguing that current models are AGI, but I don't think even this is true - current models are slightly superhuman in some narrow domains like math, human-level at a bunch of them, and still pretty stupid in some ways, most notably agency.

The reason people worry about superintelligence is that one of the "domains of interest" is AI research, and once you have an AI that's as good at AI research as your human researchers, your AI progress shoots up, probably exponentially. So the delay between automated AI research and superintelligence might be tiny.