Even if you discount superhuman AI (which I would emphasize that frontier researchers do not discount and expect to see soon) think it’s still hard to have enough confidence that the ground is solid. Someone in 2024 trying to go down this route would have invested a lot of now-pointless effort into prompt engineering.