Next step: "the AI can't find a counterexample, so the conjecture must be true!"

This is not new, most famous conjectures are believed to be true mainly because an already enormous brute force search was conducted finding no counter-example.