Remix.run Logo
SonnyTark 4 hours ago

Accelerando has prophecies that are coming true and it's scary. Spoiler warning in case you want to read it.

The first part's main character basically has the future version of openclaw running in his glasses that let him dispatch agents to do any tasks/research he wants or to autonomously do things for him. -> we are already kinda here

He's got such total dependency on his agents that when he loses his glasses he's basically no longer functional, unable to do anything for himself, doesn't know where he is or why he's there. In a way, he lost his own agency. -> this is now called skills atrophy and I'm sure it'll become a much bigger issue within the next 10 years.

Corporations are almost entirely run by AI agents, when they sue each other they use AI lawyers and verdicts are delivered by AI courts, all within milliseconds so they're basically constantly suing each other many times a second in an attempt to overwhelm each other's compute resources. -> this looks on track to happen

The entire solar system is on its way to ultimately turn into AI corporations "optimizing" for profit competing with other corporations to exhaust every little resource left in the entire system. Even after humanity itself is gone, all that's left is FAANG-like corporations competing for profit for eternity. And in the book, they find another intelligent species that succumbed to the same fate. This might just be that great filter everyone is theorizing. -> bleak and scary plausible outcome for what we're going through now.

(if I got some things wrong, I'm writing from memory. It's been years since I read this book)

tintor 9 minutes ago | parent | next [-]

“ verdicts are delivered by AI courts, all within milliseconds”

In which way is this on-track to happen?

btreecat a few seconds ago | parent | next [-]

https://www.reuters.com/legal/litigation/anthropic-expands-c...

FTA

>WASHINGTON, May 12 (Reuters) - Artificial intelligence company Anthropic on Tuesday released an expanded suite of features for lawyers using its Claude AI assistant, including tools for specialized legal topics and access within Claude to other legal research and AI products.

shantanubala a few seconds ago | parent | prev [-]

> The COMPAS software uses an algorithm to assess potential recidivism risk. Northpointe created risk scales for general and violent recidivism, and for pretrial misconduct. According to the COMPAS Practitioner's Guide, the scales were designed using behavioral and psychological constructs "of very high relevance to recidivism and criminal careers."

https://en.wikipedia.org/wiki/COMPAS_(software)

ian_j_butler 3 hours ago | parent | prev | next [-]

> Malice – revenge for waking him up – sharpens Manfred’s voice. “The president of agalmic.holdings.root.184.97.AB5 is agalmic.holdings.root.184.97.201. The secretary is agalmic.holdings.root.184.D5, and the chair is agalmic.holdings.root.184.E8.FF. All the shares are owned by those companies in equal measure, and I can tell you that their regulations are written in Python. Have a nice day, now!” He thumps the bedside phone control and sits up, yawning, then pushes the do-not-disturb button before it can interrupt again. After a moment he stands up and stretches, then heads to the bathroom to brush his teeth, comb his hair, and figure out where the lawsuit originated and how a human being managed to get far enough through his web of robot companies to bug him.

__MatrixMan__ 3 hours ago | parent | prev | next [-]

https://ucp.dev/ looks an awful lot like the first step towards Economics 2.0

staplers 2 hours ago | parent [-]

A Google API?

Glohrischi 2 hours ago | parent [-]

Yes in sense of agents to talk to agents. AI talks to another AI. Out with the humans.

growt 2 hours ago | parent | prev | next [-]

Even more fitting is the part of the story where a collective of uploaded lobster minds are involved. I wonder if that was an inspiration for the "OpenClaw" name somehow or just pure coincidence.

lxgr an hour ago | parent | next [-]

The fact that the OpenClaw creators seemingly missed that parallel tells you everything you need to know about the project.

combobyte 2 hours ago | parent | prev [-]

It was originally called "OpenClaude" before Anthropic told them to knock that off. Pretty sure "OpenClaw" was eventually picked just to be petty.

_0ffh an hour ago | parent [-]

Maybe coupled with a nod to manus-mania?

embedding-shape 2 hours ago | parent | prev | next [-]

> Corporations are almost entirely run by AI agents, when they sue each other they use AI lawyers and verdicts are delivered by AI courts, all within milliseconds so they're basically constantly suing each other many times a second in an attempt to overwhelm each other's compute resources. -> this looks on track to happen

Woah, sounds dystopian, what gives you the impression that this is on track to happen, is there "AI lawyers" already, or what's going on?

The few times I've read about AI/LLMs being used by lawyers or others in relation to law, it's always about "Someone tried to use AI, AI hallucinated and now the lawyer lost his license" which sounds proper and the "right way" to me.

collingreen an hour ago | parent [-]

A few current situations that are leaning this way in theme:

- ai facial recognition used by police, detaining innocent people with no recourse or consequences

- ai military decisions made without human in the loop. Double points for the decisions being to kill someone. Anthropic insisting a human should be in the loop for killing decisions is what caused Trump to declare them a supply chain risk.

- ai denial of insurance claims without a doctor in the loop

- ai "plagiarism" detection in college courses failing students

- that one colleague everyone has who throws slop over the wall and just sends any feedback directly to the ai

The thing you mentioned, human judges and harsh penalties for unsupervised ai lawyering, is trying to hold this kind of nightmare back. It will be very hard (and only get harder) for humans to fight through the deluge of slop, especially if the slop is weaponized as a kind of DoS like in the book. I don't expect laws are strong enough to hold this back but I don't know any other tool in our collective toolboxes.

dist-epoch 4 hours ago | parent | prev | next [-]

> Even after humanity itself is gone, all that's left is FAANG-like corporations competing for profit for eternity.

An example of why those who say "if everybody is jobless, who will buy all the products?" are just showing a lack of imagination.

generic92034 3 hours ago | parent [-]

They are not necessarily lacking imagination, they are just not providing answers to their own question. Almost everyone has read some dystopian SciFi.

AnimalMuppet an hour ago | parent | prev [-]

> and verdicts are delivered by AI courts

Yeah, I don't see that one. I don't see the legal system, the one that has people with guns to back it, giving up authority to an AI or a group of AIs.