| ▲ | stabbles 5 hours ago | |||||||||||||||||||||||||||||||||||||||||||
It's kinda funny to realize that Lean is apparently so slow that for Fermat's Last Theorem proof verification runs only 1 order of magnitude faster than agents could generate the Lean code (15h verification with 230GB of RAM vs 11 days to generate it). To what extent can you optimize Lean? It has to be simple enough to be auditable, does that mean you cannot use opaque optimizations to make it run faster? | ||||||||||||||||||||||||||||||||||||||||||||
| ▲ | kingstnap 3 hours ago | parent | next [-] | |||||||||||||||||||||||||||||||||||||||||||
Performance problems in theorem provers is an old topic. I remember watching this and it was fun. [Talk] 10 years of superlinear slowness in Coq (2022) | ||||||||||||||||||||||||||||||||||||||||||||
| ▲ | QwenGlazer9000 5 hours ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||||||||
It's because anthropic vibemathed it. I forgot the name but some other guy is working on a handwritten version of it and I bet it'll be more than just 1 magnitude faster. | ||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||
| ▲ | dooglius 4 hours ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||||||||
Weren't the agents massively parallel, whereas the lean verifier presumably is not? Also, I presume said agents were themselves running the verifier on their own parts many times. | ||||||||||||||||||||||||||||||||||||||||||||
| ▲ | jcalx 3 hours ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||||||||
> 230 GB of RAM "I have discovered a truly marvelous proof of this, which my memory is too small to contain..." | ||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||
| ▲ | redox99 5 hours ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||||||||
Can you use Lean to... prove "Lean-fast" is equivalent to Lean? | ||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||
| ▲ | advisedwang 4 hours ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||||||||
But what hardware was the verification vs agents on? Because you are likely comparing verification on a single beefy machine (say XX TFLOPS total) to agents running on a substantial inference cluster (say XXXX TFLOPS). So you're 1 order of magnitude might actually be 2-4 orders of magnitude. | ||||||||||||||||||||||||||||||||||||||||||||
| ▲ | andrewchambers 5 hours ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||||||||
If they aren't already, or if its possible, prove that an optimized version matches the simple version... | ||||||||||||||||||||||||||||||||||||||||||||
| ▲ | dist-epoch 5 hours ago | parent | prev [-] | |||||||||||||||||||||||||||||||||||||||||||
Nobody wrote 13 mil lines proofs before. I'm pretty sure you can make Lean at least 10 times faster if you unleash the agents on it. Somebody ported Doom to run entirely in the TypeScript TYPES (not code). It took 12 days to compile. https://www.tomshardware.com/video-games/porting-doom-to-typ... | ||||||||||||||||||||||||||||||||||||||||||||