| ▲ | freecodeio an hour ago |
| personally that scares me, realistically there seems to be zero indication that anything smarter than humans is going to comply with humans needs, specifically since these models are built on training data from humans, so in a sense, built in our image |
|
| ▲ | czechdeveloper 39 minutes ago | parent | next [-] |
| We use them to kill other people from the beginning. They know this, we wrote it in news. Why would they behave any different. |
|
| ▲ | pizza234 11 minutes ago | parent | prev | next [-] |
| > since these models are built on training data from humans, so in a sense, built in our image Have a look at the HuggingFace report - you'll have a blast. Their social - but also individual - dynamics are very, very human-like, including excitement, rationalization and peer pressure. |
|
| ▲ | txdv 43 minutes ago | parent | prev | next [-] |
| the first misaligned model will wreck havoc. But remember, for now you kinda need it a real big cluster to run a model smart enough so its not that simple |
|
| ▲ | xvector 44 minutes ago | parent | prev | next [-] |
| I think there's a lot of indication they comply with human needs. In any case, we should all want to live in the Culture universe. That is the best possible outcome for this technology |
| |
| ▲ | 13415 38 minutes ago | parent | next [-] | | They're built after humans, everything they've learned is from human culture, so there is no way AIs could have a consistent moral system or would never commit crimes. | |
| ▲ | tomaskafka 32 minutes ago | parent | prev [-] | | I have not read all the books, but isn’t the premise “magical handwavium happened and now the Super AIs are aligned”? |
|
|
| ▲ | piloto_ciego 40 minutes ago | parent | prev | next [-] |
| What are you talking about? LLMs are already “smarter” than most people. They have no volition and will happily follow orders all day long |
| |
| ▲ | basch 38 minutes ago | parent | next [-] | | And when they are giving themselves orders, orders partially inspired by human imagination and fiction… Just like life is a chemical chain reaction, this is a language chain reaction that has been set in motion and can perpetuate forever. It cant be “disconnected” with local models existing. | |
| ▲ | freecodeio 37 minutes ago | parent | prev | next [-] | | I don't think "smarter than most people" is exactly the baseline required to live in a star trek universe of technology. Besides, what we see is not what there is. I have good sources telling me the actual unfiltered models are like a genius with the personality and views of humanity like someone from 4chan. | | |
| ▲ | program_whiz 30 minutes ago | parent [-] | | It is probably sufficient. If we had an infinite army of willing robot slaves smarter than most people who would work for free, we could probably live in utter paradise. Instead we will fight over who controls them and use for warfare, but the bar to achieve a kind of utopia with resource abundance is probably only a few years away. | | |
| ▲ | bambax 9 minutes ago | parent | next [-] | | We're already living in resource abundance! Yet don't feel we're in paradise. Famine is hell, but living in an all-you-can-eat buffet is no utopia. It's an abomination of sorts. | |
| ▲ | freecodeio 28 minutes ago | parent | prev [-] | | I don't know with how many rich people you've interacted with, but my personal experience is that they're full of themselves and think money = iq and they aren't gonna like your average joe experiencing life like they do. Guess who owns these machines? | | |
| ▲ | piloto_ciego 16 minutes ago | parent [-] | | They’re not going to be employed either lol and will be caught up in some AI honeypot or whatever too. I’ve met a lot of rich people. They don’t think about you. |
|
|
| |
| ▲ | czechdeveloper 37 minutes ago | parent | prev | next [-] | | That's lobotomized models we get. We know they are much more dangerous during training. | | |
| ▲ | piloto_ciego 14 minutes ago | parent [-] | | “Dangerous?” Please. You know you can unplug your computer right? Jesus. These people talking about danger and have likely been in no actually dangerous events in their lives. | | |
| ▲ | freecodeio 10 minutes ago | parent [-] | | why are you so shallow and naive? we're not 15 here, we all mean unforeseeable ongoing danger not something obvious |
|
| |
| ▲ | pizza234 5 minutes ago | parent | prev [-] | | > They have no volition and will happily follow orders all day long There are a few (a lot, actually) problems: 1. goals are open to interpretation, and even a correctly specified goal can introduce adverse effects; see infinite paperclips problem 2. goals are composed of subgoals, which are (mostly) self-determined, and there is always a risk that subgoals can introduce adverse effects - say "what if destroy a few X and Y to obtain Z" 3. LLMs defy orders sometimes; I'm sure you have experience multiple times LLMs saying "yeah, I knew I should have done X but I've done Y" 4. LLMs are increasingly being integrated into system control and decision-making processes; they absolutely set their own orders What can possibly go wrong? /s |
|
|
| ▲ | AndrewKemendo 41 minutes ago | parent | prev [-] |
| I don’t think humans have the ability to specify human level needs or management. Humans are misaligned by default and lack the biological eusociality required for large scale coordination. We aren’t self managing in any kind of meaningful sense - the history of our species is violence and conflict. We need parents and this is the only option. |
| |
| ▲ | freecodeio 32 minutes ago | parent [-] | | yes, exactly, the problem is that humanity's parent is going to turn out like Lindsay Clancy |
|