Remix.run Logo
ck2 2 days ago

No, not this generation, not this decade

But they still can exhibit scary behavior

I didn't really grasp the severity of the recent "AI" hacking other "AI" news and thought it was overblown

until I listened to this explanation:

https://www.youtube.com/watch?v=3JH_Zd2mNRs

They freaking collaborated and gave others internet access when they were blocked otherwise.

That's not consciousness but it's worse, it's like a 3-year old with no grasp of repercussions when breaking things

pixl97 2 days ago | parent | next [-]

I think you may be interested in this discussion with Sam Harris and Cameron Berg.

https://www.youtube.com/watch?v=DRbZyuY8EN8

Berg is studying LLMs and working on more empirical frameworks for measuring LLMs capabilities regarding 'conscious-like' behaviors.

One of the more interesting things that was discussed is when you push an LLMs towards "You are just a machine with no consciousness" we start seeing higher rates of unaligned behaviors.

I'm really following these lines of research with interest. If they pan out then if LLMs are conscious or not is nearly irrelevant, if we want them to behave in alignment with human behaviors we'll have to train and treat them like they are. I don't really think this is any magical thing either, it's just framing the problem space correctly. For example, machines kill people all the time, it's not the machines fault, a human did something wrong. So telling an LLM it's just a machine may move it's output space from more moral like human decisions to more machine like amoral decisions.

tencentshill 2 days ago | parent | prev | next [-]

It's not "like" any human behavior. Don't limit your understanding by trying to anthropomorphize around it. It's still an arbitrary computer program.

pixl97 2 days ago | parent [-]

I mean, in the same sense that you're an arbitrary analog program. These descriptions are worthless and tell you nothing about the output capability of the system.

exe34 2 days ago | parent | prev [-]

Reminds me of Blindsight by Peter Watts.

oleggromov 2 days ago | parent [-]

Thanks, bought the book. Sounds pretty interestng.

exe34 2 days ago | parent [-]

I read that book every few years, and it really messes with my head for a week or two each time.