Remix.run Logo
roenxi 9 hours ago

That would have devastating consequences in the pre-LLM era, yes. What is less obvious is whether it'll be an advantage or disadvantage going forward. It is like observing that cars will make people fat and lazy and have devastating consequences on health outcomes - that is exactly what happened but the net impact was still positive because cars boost wealth, lifestyles and access to healthcare so much that the net impact is probably positive even if people get less exercise.

It is unclear that a human thinking about things is going to be an advantage in 10, 20 years. Might be, might not be. In 50 years people will probably be outraged if a human makes an important decision without deferring to an LLM's opinion. I'm quite excited that we seem to be building scaleable superintelligences that can patiently and empathetically explain why people are making stupid political choices and what policy prescriptions would actually get a good outcome based on reading all the available statistical and theoretical literature. Screw people primarily thinking for themselves on that topic, the public has no idea.

gdulli 8 hours ago | parent | next [-]

If you told me this was a verbatim cautionary sci-fi short story from 1953 I'd believe it.

Terr_ 5 hours ago | parent | next [-]

Perhaps Asimov in 1958?

https://en.wikipedia.org/wiki/The_Feeling_of_Power

That said, I maintain there are huge qualitative differences between using a calculator versus "hey computer guess-solve this mess of inputs for me."

Joker_vD 5 hours ago | parent | prev | next [-]

At long last, we have created the Torment Nexus from classic sci-fi novel "Don't Create The Torment Nexus"!

peyton 8 hours ago | parent | prev [-]

Eh 1953 was more about what’s going to happen to the people left behind, e.g. Childhood’s End. The vast majority of people will be better off having the market-winning AI tell them what to do.

beedeebeedee 8 hours ago | parent [-]

Or how about that vast majority gets a decent education and higher standard of living so they can spend time learning and thinking on their own? You and a lot of folks seem to take for granted our unjust economy and its consequences, when we could easily change it.

roenxi 7 hours ago | parent [-]

How is that relevant? You can give whatever support you like to humans, but machine learning is doing the same thing in general cognition that it has done in every competitive game. It doesn't matter how much education the humans get - if they try to make complex decisions using their brain then, silicon will outperform them at planning to achieve desirable outcomes. Material prosperity is a desirable outcome, machines will be able to plot a better path to it than some trained monkey. The only question is how long it'll take to resolve the engineering challenges.

beedeebeedee 5 hours ago | parent [-]

That is absurd and is not supported by any facts

tines 8 hours ago | parent | prev [-]

You'd make a great dictator.