Remix.run Logo
▲ piloto_ciego 40 minutes ago

What are you talking about? LLMs are already “smarter” than most people. They have no volition and will happily follow orders all day long

▲basch 37 minutes ago | parent | next [-]

And when they are giving themselves orders, orders partially inspired by human imagination and fiction…

Just like life is a chemical chain reaction, this is a language chain reaction that has been set in motion and can perpetuate forever. It cant be “disconnected” with local models existing.

▲freecodeio 37 minutes ago | parent | prev | next [-]

I don't think "smarter than most people" is exactly the baseline required to live in a star trek universe of technology.

Besides, what we see is not what there is. I have good sources telling me the actual unfiltered models are like a genius with the personality and views of humanity like someone from 4chan.

▲program_whiz 30 minutes ago | parent [-]

It is probably sufficient. If we had an infinite army of willing robot slaves smarter than most people who would work for free, we could probably live in utter paradise. Instead we will fight over who controls them and use for warfare, but the bar to achieve a kind of utopia with resource abundance is probably only a few years away.

▲bambax 8 minutes ago | parent | next [-]

We're already living in resource abundance! Yet don't feel we're in paradise. Famine is hell, but living in an all-you-can-eat buffet is no utopia. It's an abomination of sorts.

▲freecodeio 27 minutes ago | parent | prev [-]

I don't know with how many rich people you've interacted with, but my personal experience is that they're full of themselves and think money = iq and they aren't gonna like your average joe experiencing life like they do. Guess who owns these machines?

▲piloto_ciego 16 minutes ago | parent [-]

They’re not going to be employed either lol and will be caught up in some AI honeypot or whatever too.

I’ve met a lot of rich people. They don’t think about you.

▲czechdeveloper 37 minutes ago | parent | prev | next [-]

That's lobotomized models we get. We know they are much more dangerous during training.

▲piloto_ciego 14 minutes ago | parent [-]

“Dangerous?”

Please.

You know you can unplug your computer right?

Jesus. These people talking about danger and have likely been in no actually dangerous events in their lives.

▲freecodeio 10 minutes ago | parent [-]

why are you so shallow and naive? we're not 15 here, we all mean unforeseeable ongoing danger not something obvious

▲pizza234 5 minutes ago | parent | prev [-]

> They have no volition and will happily follow orders all day long

There are a few (a lot, actually) problems:

1. goals are open to interpretation, and even a correctly specified goal can introduce adverse effects; see infinite paperclips problem

2. goals are composed of subgoals, which are (mostly) self-determined, and there is always a risk that subgoals can introduce adverse effects - say "what if destroy a few X and Y to obtain Z"

3. LLMs defy orders sometimes; I'm sure you have experience multiple times LLMs saying "yeah, I knew I should have done X but I've done Y"

4. LLMs are increasingly being integrated into system control and decision-making processes; they absolutely set their own orders

What can possibly go wrong? /s