| ▲ | causal 4 hours ago |
| Whoa. One real problem with depending on Lean is that if there are any real bugs, then sufficiently-large swarms of agents are guaranteed to eventually come up with proofs that depend on the bug. |
|
| ▲ | striking 3 hours ago | parent | next [-] |
| This comes up frequently in threads but it's actually a much less impactful issue than you might think. There are actually several entirely disjoint implementations of Lean, each with different bugs; it is incredibly unlikely an agent would be able to exercise the same bug in every single implementation. |
| |
| ▲ | javra 4 minutes ago | parent | next [-] | | Some of the reimplementations are actually verified, so guaranteed to be free from the sort of bugs found in the main kernel recently. | |
| ▲ | tomjakubowski 2 hours ago | parent | prev [-] | | Does a malicious proof need to exercise the same bug in all the engines necessarily? Why couldn't it exercise a different bug in each engine? | | |
| ▲ | foota 2 hours ago | parent [-] | | You could maybe address this through holding out the other implementations and using them only to verify? | | |
| ▲ | ok_dad an hour ago | parent [-] | | I doubt that any of them are closed-source, so the clankers probably already know all their bugs. Who says they all don't share a similar bug that is necessary for the proof to work? No one is going to review 1.3GB of anything by hand, even if they could understand it all in a single lifetime. | | |
| ▲ | gus_massa 41 minutes ago | parent [-] | | > so the clankers probably already know all their bugs I agree. So if the AIs knows some bugs, they will be using them to prove all kind of fake stuff, not only interesting stuff. https://xkcd.com/704/ |
|
|
|
|
|
| ▲ | empath75 3 hours ago | parent | prev | next [-] |
| I found a bug in Lean a couple of weeks ago with an LLM, in fact, but it was in its 'macro' system that expands code into statements, not the actual proof system. It wouldn't have proven anything false, but it could have produced statements that aren't what you intended. |
|
| ▲ | red75prime 4 hours ago | parent | prev [-] |
| ...if it's tasked to find proofs of False assuming that there are still bugs left. |