The AI would build a proof of correctness, which would be then verified in a proof checker (not AI).