I disagree with this take. While LLMs themselves are currently unreliable, the work done in the math community on hooking up creative LLMs to reliable verifiers like Lean show that it’s possible to construct systems where the unreliability is suppressed. For now, that still requires experts to set up and monitor, but I do believe that in a couple of decades we’ll make progress on how to do more mundane tasks in a reliable way without expert supervision, where an LLM still sits as the translation layer between humans and machines. And that universal human-to-machine translator, I would certainly consider a foundational technology.

EDIT: If you asked people on the street in 1990, they’d probably not consider the Internet to be in the same category as the Steam engine either. I mean, you already had phone and fax, so it wasn’t that ground breaking. And I’ve even read articles from the mid-90s declaring the Internet a temporary fad.

> I disagree with this take. While LLMs themselves are currently unreliable, the work done in the math community on hooking up creative LLMs to reliable verifiers like Lean show that it’s possible to construct systems where the unreliability is suppressed. For now, that still requires experts to set up and monitor, but I do believe that in a couple of decades we’ll make progress on how to do more mundane tasks in a reliable way without expert supervision, where an LLM still sits as the translation layer between humans and machines. And that universal human-to-machine translator, I would certainly consider a foundational technology.

Yes, for a verifiable domains you can set up a harness and brute-force a search space if you have enough money for compute. Why do you think they keep coming up with those examples of impressive achievements like solving math puzzles? Why not focus on something with economic value to it? My answer is they can't, those are hard problems, those require building an actual product, those require reliability.

> EDIT: If you asked people on the street in 1990, they’d probably not consider the Internet to be in the same category as the Steam engine either. I mean, you already had phone and fax, so it wasn’t that ground breaking. And I’ve even read articles from the mid-90s declaring the Internet a temporary fad.

We are not people people on the street we are people who are directly involved in application of the technology, we posses a higher level of insight.

> hooking up creative LLMs to reliable verifiers like Lean show that it’s possible to construct systems where the unreliability is suppressed.

You can also have LLMs create these things called "programs" that are written in "code" that result in deterministic outputs when given inputs.

I say this with a bit of snark to highlight the point that both humans and LLMs can write code that is cheaper to run and easy to verify. I'm not saying Lean being used like this is a bad idea, just that it's just one end of the spectrum.

I share this sentiment, while deploring the current AI board room sentiment. I know some people that design (safe) buildings. They use software all the time for their load-bearing work (lol). Think about the creativity that could be unleashed if that (like LEAN for math) becomes a commodity.

The same thing for my job: creating insurance premiums is somewhat hard but not stellar. A combination of skills, data, tools and people. I can imagine a future where you can post a 'have good weather on holiday or money back' bond on a platform. (I can think of more serious applications...) The sheer diversity and amount of liquidity AI's can create is enormous. (Switching to a very general outlook here.) And with liquidity hopefully comes more specificity in the ROI on saving our planet. (Or the disproving of the necessity thereof, if that is your outlook.)

Most notably Paul Krugman Nobel winning economist in 98: "By 2005 or so, it will become clear that the Internet’s impact on the economy has been no greater than the fax machine’s."

Predicting the future is hard.

I don't think you've said anything different than the person you're responding to. The difference primarily seems to be whether you think AI is transformative vs simply being another tool (which is really just a matter of perspective).

If you're not an expert software engineer, it's transformative. If you are, it's just another tool.