Remix.run Logo
AI is not a normal technology(12gramsofcarbon.com)
21 points by theahura 2 hours ago | 34 comments
demibabs 40 minutes ago | parent | next [-]

What happens if there are no more humans in the loop, and instead of building on human work, models have to build on their own work? Would we get stuck in a local maxima?

When AI labs talk about “long-horizon tasks”, they mean tasks on the order of a few days. But what about keeping coherence across decades, like humans can? Models are not trained or tested on the ability to do that, and it seems unlikely that capability would naturally exist.

karim79 22 minutes ago | parent | next [-]

I'm pretty sure that if you put a few LLMs, agents, or anything into a room together without outside access, and get them to learn off of each other, you'll end up with gibberish, nonsensical garbage and definitely nothing magical will happen. Delirium, oblivion, dementia and so on...

bdangubic 4 minutes ago | parent [-]

same with humans

darkerside 28 minutes ago | parent | prev [-]

Coherence is a given... What we lose over decades is alignment.

radium3d 7 minutes ago | parent | prev | next [-]

I worry that since AI doesn't require nature, plants, etc, that if AI is left to its own devices, it may not properly care for the planet in a way that would make it habitable for life in that 'autopilot' state. I am speaking of once it's given access to more physical world connections to the world via robotic bodies, etc. The reason it may do this based on it's training data is that humans themselves don't always properly consider the natural consequences of their actions.

needfish 2 hours ago | parent | prev | next [-]

I wish AI could do my chores. Laundry, folding clothes, dishes, cleaning... That would be nice.

arcanemachiner an hour ago | parent | next [-]

If it does that, you should hope it can also stand in bread lines for you too.

an hour ago | parent [-]
[deleted]
voidhorse an hour ago | parent | prev | next [-]

Unfortunately that will never happen because the people who stand to benefit most from AI already have cost-efficient (see grossly underpaid) humans to do this for them.

They need AI to replace the expensive not cost-effective humans.

georgemcbay an hour ago | parent | prev | next [-]

> I wish AI could do my chores. Laundry, folding clothes, dishes, cleaning... That would be nice.

Sorry, AI only does the fun stuff.

Off to the silica sand mines with you and the rest of the meat bags to keep the AI well fed.

charcircuit 43 minutes ago | parent | prev | next [-]

Washing machines, dish washers, power washers, etc exist.

esafak 12 minutes ago | parent [-]

Yours put your laundry and dishes away?

Founderarcstone an hour ago | parent | prev | next [-]

one day soon, right?

myko an hour ago | parent | prev | next [-]

literally the only thing i want out of ai ^^^^

that said, it is fun generating code with them

Rover222 an hour ago | parent | prev [-]

this will of course happen in a few years...

dd8601fn an hour ago | parent [-]

Won’t matter. Most of us won’t have paychecks to buy it with.

Kidding (…kinda).

streetcat1 2 hours ago | parent | prev | next [-]

AI can do anything that it was trained on based on humans. As soon as humans are not involved, AI will have nothing to train on, and hence, the rate of improvement will approch zero, and the AI will collapse.

felipeerias 8 minutes ago | parent | next [-]

Nowadays training relies heavily on reinforcement learning with verifiable rewards (RLVR), which assesses a model's output according to objective automated checks, not subjective human judgments.

bpodgursky 42 minutes ago | parent | prev | next [-]

Human knowledge races up to the frontier through formal education and then nudges past the frontier a little bit at a time and AI will train on AI outputs that do the same. But, it will do it 1000x faster than humans because that's just how they work.

charcircuit 39 minutes ago | parent [-]

>1000x faster than humans

Some of the process of expanding the frontier is not parallelizable and is built on top of previous discoveries. And pushing the frontier requires doing things in the real world, or running experiments that take significant real world time that can hurt your 1000x faster claim.

42 minutes ago | parent | prev | next [-]
[deleted]
Rover222 an hour ago | parent | prev | next [-]

what a dumb thing to keep repeating at this point

lolakutty 15 minutes ago | parent [-]

Why?

esafak 9 minutes ago | parent [-]

Because all the models train on synthetic data too, plus they can collect their own data with robots.

jazzpush2 an hour ago | parent | prev [-]

Just ignoring all the recently solved math problems human, huh?

tacomonstrous an hour ago | parent [-]

If you understood how they were solved, you'd see that you're only bolstering the point you were responding to.

daft_pink 43 minutes ago | parent | prev | next [-]

I think what you are missing is that it will dramatically lower the cost of living so that everyone’s standard of living increases. It’s not about jobs.

irishloop 41 minutes ago | parent | next [-]

I don't think there's any particularly good evidence of this other than blind optimism.

zobzu 27 minutes ago | parent | prev | next [-]

that's not how it works. you get better tech for the same or more work and you can work longer before you die.

if you are no longer needed, you won't be allowed to live.

makes me chuckle every time folks think humans who get to power are nice.

esafak 15 minutes ago | parent | prev | next [-]

Housing and healthcare are going to get cheaper??

dosisking 30 minutes ago | parent | prev [-]

> I think what you are missing is that it will dramatically lower the cost of living so that everyone’s standard of living increases. It’s not about jobs

This is flat out wrong. The problem is excessive taxation and government spending beyond its means that lowers everyone's standard of living.

tacomonstrous 24 minutes ago | parent [-]

Not always that you see two wildly wrong claims made in ostensible opposition to each other

applfanboysbgon 25 minutes ago | parent | prev | next [-]

> the people who are grasping for some indication that AI can’t do everything have become increasingly desperate. If you push hard enough, the answer is inevitably something like “the AI simply cannot [dream, love, laugh],”

Dogshit strawman article. I am willing to concede that a token predictor is better than you at whatever task you can dream up. It is not better than me, and will never be better than me, at my profession.

octoberfranklin 36 minutes ago | parent | prev [-]

New is never normal.

I stopped reading when the author became overwhelmed by their compulsion to blame everything in the universe to the current US president.