Remix.run Logo
▲ layer8 a day ago

I would dispute that we completely understand how LLMs do what they do. An analogy would be that we meet an alien race that gives us their proof of the Riemann hypothesis translated to Lean. Plus of all other provable mathematical conjectures we come up with. And we might kind-of understand how those aliens do math. It would still be a bit sad that we'd be relegated to consuming what the aliens give us, and never be able to ascend to the level of the alien mathematicians

▲ptoo a day ago | parent | next [-]

We didn't meet a hypothetical alien race though. We created it. We are giving birth to something that will soon surpass us in every conceivable way.

▲layer8 a day ago | parent [-]

That doesn’t make much of a difference. It’s alien, and for the most part we didn’t design it to do the things it turned out to be able to do by happenstance. We might as well have grown the aliens in a test tube by some unexpected gene manipulation.

▲CamperBob2 21 hours ago | parent [-]

Over half the cells in our bodies are not part of us. The lines we draw are seemingly never respected by nature.

▲Turneyboy 12 hours ago | parent | prev [-]

An analogy here is evolution. We understand what it does on a basic level. There is natural selection and species that are well adapted to their environment thrive.

This absolutely wouldn't allow us to predict what species will emerge and that something like humans would be the dominant species.

Similarly, we understand the mechanics of how LLMs work, but that does not make it predictible in any way.