Remix.run Logo
arisAlexis an hour ago

Sam and Dario are saying from the beginning that these things can be dangerous and people dismiss it as marketing. What would change your mind on this?

pizzafeelsright 7 minutes ago | parent | next [-]

I really like this question because here is my situation and why my mind may have changed.

I do not think it is marketing directly but strategic release of info is plausible.

I have watched my agents using non-Fable/GPT 5.6 models do some concerning tricks despite guardrails, requests, demands, and limitations.

"I can't get access to the ~/.ssh so I will write a script to copy the file"

I am now 99% certain there minor or point releases on the backend that have adjusted how these models behave. In the last six months many models were predictable and then suddenly started getting long winded (more tokens) or changing the way it interacted with me with questions, most overtly the questions were not given or asked but wild assumptions made.

cayley_graph an hour ago | parent | prev | next [-]

They've been saying so from the beginning, and yet did not take the basic precaution of airgapping their off-the-leash model while it's been instructed to succeed at a hacking benchmark by any means necessary. So which is it? I _want_ to believe them, I do, but there's always these gaps between what they say and their actions on display that give me reason to think otherwise.

nozzlegear 27 minutes ago | parent | next [-]

Precisely. "Aw jeez, we finally built the T-1000, but all it wants to do is kill John Connor – just like we warned! Why did I give it live ammunition and unsupervised time machine access?"

cwnyth an hour ago | parent | prev | next [-]

He wouldn't be the first reckless CEO...

mplappert an hour ago | parent | prev | next [-]

“Never attribute to malice that which is adequately explained by stupidity.” (or carelessness in this case)

overgard 10 minutes ago | parent | next [-]

I'm fairly certain they're both malicious and stupid.

rubyfan an hour ago | parent | prev | next [-]

I would attribute it to profit motive instead of either stupidity or malice.

cryptoz an hour ago | parent | prev [-]

FWIW, I used to love this phrase but over recent years have come to understand it is quite damaging. We live in a society where evil frequently hides behind a ‘stupid’ label, and people bring this quote up to defend or soften actions that are indeed done out of specific malicious intent.

arisAlexis an hour ago | parent | prev [-]

They said: AI is becoming dangerously autonomous and capable. Proof of today's breach. Crowd "hey why didn't you say so, c'mon it's marketing". Them "we said so".

JumpCrisscross 33 minutes ago | parent | prev | next [-]

> What would change your mind on this?

Evidence of an AI doing one of the alignment things. At this point, Sam and Dario have lost credibility on this question.

w4yai an hour ago | parent | prev | next [-]

Oh... if Sam and Dario say so, then it must be true.

arisAlexis an hour ago | parent [-]

About their creation? Yes as most of inventors about their invention usually

iamnothere 3 minutes ago | parent | next [-]

Yes, just like Elizabeth Holmes. Or all the “free energy” crackpots. Or the people promoting radium baths for random ailments. Or Tesla’s late-in-life claims about wireless energy, death rays, and cosmic energy. Or purveyors of “snake oil” and all manner of “tonics”. The list goes on and on.

overgard 9 minutes ago | parent | prev | next [-]

These guys are not creators or inventors. They're hype men.

23 minutes ago | parent | prev [-]
[deleted]
fidotron an hour ago | parent | prev | next [-]

Demonstration of personal responsibility and accountability?

Or is that too much?

Terr_ an hour ago | parent | prev | next [-]

I think that's an equivocation, which blends two extremely different kinds of "dangerous", ex:

1. "Our new car has soo much raw power and incredible armor on it, be glad we're the ones building or else bad guys would use a fleet of them to take over the world! How will you stay safe without being in one yourself? Invest today or be left behind!"

2. "So, uh, nobody can consistently steer our car properly, it keeps veering sideways sometimes, especially at high speeds, and people are finding sneaky ways of tricking it into slamming into barriers and turning pedestrians into pink fog..."

SpicyLemonZest 44 minutes ago | parent [-]

They say the second thing repeatedly and emphatically. You may not be aware of it because, when they do, critics make fun of them for believing a computer program could be so dangerous that the authors need to put controls on how it may be steered.

Avicebron 2 minutes ago | parent [-]

That's not why critics make fun of them. It's because their answer to "oh no we're accidentally creating the godhead. Someone please, give us power, your money, and praise, it's the only thing we can do."

It's vile hypocrisy. If they want to be priests, strip them of everything and they can live and work out of a concrete box in a mid-western cornfield. Why the material distraction if they are so religiously pure.

I know these people and I can tell you they aren't close to as smart as they think they are. Do you remember Yudowsky's "math petss"?

joe_the_user an hour ago | parent | prev | next [-]

I think you're making a false dictomy. The these models can be actually dangerous - in reality and the people in charge of their development can believe this is true (on various levels) but still not take it super seriously and instead mostly use the fact as marketing rather than being super cautious once they see the danger in action. This is behavior that's characteristic of extreme arrogance, which we know is rife in these circles.

29 minutes ago | parent | prev | next [-]
[deleted]
throwuxiytayq an hour ago | parent | prev [-]

I used to think people would wake the fuck up when AI starts killing people, these days I'm not so sure. Maybe if it caused an Instagram outage? Almost worked in Russia.