How about AI solves climate change next? That's an important open problem.

You forgot to add "make no mistakes"

Climate change has many clean solutions lol. Just none that anyone gives a fuck about enacting. We'll deal with it post singularity (if we even care then)

It's not the type of problem where a useful solution can be verified in Lean. Which makes LLMs a lot less good at solving that type of problem.

One possible path is human extinction. I guess with current alignment problems, it may be the chosen path. :|