Remix.run Logo
▲ digitaltrees 5 hours ago

Its time to institute involuntary dissolution of these firms. They don't get to make these choices on behalf of humanity simply because they set up a Delaware corporate entity. They are behaving wildly irresponsibly.

▲danielmarkbruce 5 hours ago | parent | next [-]

They have a some engineers and researchers saying things. Anyone at a tech company in the bay area will know there are a some peculiar ideas in the heads of some (not most) otherwise intelligent engineers and researchers in tech. That's not proof they are wrong but it's worth considering these folks are wrong and that these companies aren't producing anything especially dangerous. Fable stumbles on enough things I throw at it that I'm... not especially scared.

▲digitaltrees 3 hours ago | parent | next [-]

I built a harness. I know that the models can do. They have the ability execute bash scripts, and autonomous navigate the internet. Those two abilities are sufficiently powerful to take down core social infrastructure either triggered by a human hacker or autonomously.

I think we should have mandatory logging of every executed command, mandatory public disclosure of every unauthorized access of a system both parties didn’t consent to and personal liability for the user, the company and its executives and shareholders. Security would get much tighter if accountability existed.

▲danielmarkbruce 3 hours ago | parent [-]

A process could execute bash scripts and autonomously navigate the internet since the start of the internet...

Bad guys wouldn't do it. And liability already exists, you can sue. This is America.

▲digitaltrees 3 hours ago | parent [-]

Scripts are inspectable and attributable. Long running agents can devise plans and execute them in ways their prompter never envisioned or intended. That is materially different.

▲danielmarkbruce 3 hours ago | parent [-]

If I write some code to take the output of a model and execute it, that's on me. I don't get to just trust any old input and run it.

I'm also the one who makes it long running.

▲vrganj an hour ago | parent | prev | next [-]

Maybe the truly dangerous thing is all the power concentrated in this small group of people with peculiar ideas, not their specific cyber-eschatology?

Maybe the ones with the peculiar ideas shouldn't be the one "aligning" what a model tells the rest of the world?

▲irisflower95 5 hours ago | parent | prev [-]

Could you please elaborate more on these peculiar ideas?

▲augment_me 5 hours ago | parent | next [-]

Most people currently in the positions of power at these companies are tied together by their belief systems. It's like a group of college friends who have slept with each other, and very influenced by effective altruism(EA), kind of reiterating each others points.

Like Sam Altman meeting his husband in Peter Thiel's pool. Thiel funds a lot of these ventures together with Andreassen, who is on boards of non-profits. Dario Amodei's sister Daniela who is president of Anthropic is married to an EA non-profit founder who is also on the board of these non-profits and is tied with the prior mentioned investors. Elon is in there as well, Yudkowski is mingling with Altman, etc.

Blogs on this: https://contraptions.venkateshrao.com/p/ea-safety https://www.iankduncan.com/personal/2026-09-16-sex-ai-and-th...

There are some camps amongst them like the proponents for Regulation/Slowdown or Acceleration, but these are in practice mostly used for economical and not political decisions (like regulatory capture).

The point here is that this is a small group of people with a homogeneous background who are not really seeking input from anyone else on issues that are concerning most of humanity.

Like, if you said that the future of informational work and livelihood of humans is in the hands of 20-30 year transhumanists who think they are building mechagod that will trancsend social, political and religious separations of the world and bring everyone abundance, you would not feel like this is a serious thing to suggest.

▲danielmarkbruce 5 hours ago | parent | prev [-]

The google engineer who thought their chatbot was sentient 4 or 5 years ago is an exambple, but I just meant in general - if you hang around any big tech company for a while you'll see some quite interesting characters.

▲chii 43 minutes ago | parent | prev | next [-]

> They don't get to make these choices on behalf of humanity

and yet, every carbon emitter in the world contributes to the demise of the climate, but you don't call for their dissolution (which would, conveniently, include yourself).

▲ReptileMan 3 hours ago | parent | prev [-]

Train better models with blackjack and hookers and you will get to make decisions on behalf of humanity.