Remix.run Logo
al_borland 5 hours ago

> Experts in artificial intelligence estimate...

The predictions of these "experts" have been drastically wrong for the last 3 years. At what point does someone lose their "expert" title?

Waterluvian 4 hours ago | parent | next [-]

Those are the experts who were wrong. These are the experts who are right. We sacked the experts who are wrong and replaced them with the experts who are right.

“How do we know they’re right?” I hear you ask. We know because we who are wrong and these ones aren’t them. So they can’t make wrong predictions because those who make wrong predictions have been sacked.

DrBazza 2 hours ago | parent | next [-]

Channeling your inner Douglas Adams.

mdp2021 3 hours ago | parent | prev [-]

Namely? Who sacked who, who confirmed who?

holmesworcester 3 hours ago | parent [-]

The AI experts who started the AI labs that are about to IPO were right, at least.

somesortofthing an hour ago | parent | prev | next [-]

Have they? I don't like it either but the headline bull predictions(reliable agents and most code written by AI by mid-2026, dramatic progress against jailbreaks, prompt injection, hallucination, etc., major improvements despite pretraining data exhaustion, continued exponential growth on the METR trendline) did come true, often ahead of even aggressive schedules. What major wrong predictions did you have in mind?

bigstrat2003 an hour ago | parent [-]

Literally none of the predictions you listed in your post came true. We don't have reliable agents, AI isn't writing most code, hallucinations still happen all the time, improvement has been basically non-existent. Despite the constant claims of these experts and AI boosters, AI is still not a tool one can use to get meaningful work done.

ianm218 4 hours ago | parent | prev | next [-]

Do you have a source on aggregate predictions of experts being drastically wrong?

I.e. the AI 2027 guys were memed for being AI lunatics on a lot here and they have been pretty on the money in terms of pace of progress accelerating/ gov moving towards nationalization/ coding agents

somenameforme 3 hours ago | parent | next [-]

No they haven't. They've even 'officially' declared that their AI apocalypse has been postponed to another date [1], just out of reach, but close enough to be scary. Though in the quotes there the doomsayers are also already pre-hedging for why AI 2030 also won't come to pass.

[1] - https://garymarcus.substack.com/p/breaking-the-ai-2027-dooms...

Retric 3 hours ago | parent | prev | next [-]

Do you have specific and objective examples of things people got right?

From my perspective there’s very slow but very real progress happening in the AI space. I see people making wild predictions in both directions, but in terms of actual unsupervised utility there’s definitely progress abet wildly slower than most hype.

frognumber 3 hours ago | parent | next [-]

This was their prediction for 2026:

"The bet of using AI to speed up AI research is starting to pay off.

OpenBrain continues to deploy the iteratively improving Agent-1 internally for AI R&D. Overall, they are making algorithmic progress 50% faster than they would without AI assistants—and more importantly, faster than their competitors. The AI R&D progress multiplier: what do we mean by 50% faster algorithmic progress?

Several competing publicly released AIs now match or exceed Agent-0, including an open-weights model. OpenBrain responds by releasing Agent-1, which is more capable and reliable.28

People naturally try to compare Agent-1 to humans, but it has a very different skill profile. It knows more facts than any human, knows practically every programming language, and can solve well-specified coding problems extremely quickly. On the other hand, Agent-1 is bad at even simple long-horizon tasks, like beating video games it hasn’t played before. Still, the common workday is eight hours, and a day’s work can usually be separated into smaller chunks; you could think of Agent-1 as a scatterbrained employee who thrives under careful management.29 Savvy people find ways to automate routine parts of their jobs.30

OpenBrain’s executives turn consideration to an implication of automating AI R&D: security has become more important. In early 2025, the worst-case scenario was leaked algorithmic secrets; now, if China steals Agent-1’s weights, they could increase their research speed by nearly 50%.31 OpenBrain’s security level is typical of a fast-growing ~3,000 person tech company, secure only against low-priority attacks from capable cyber groups (RAND’s SL2).32 They are working hard to protect their weights and secrets from insider threats and top cybercrime syndicates (SL3),33 but defense against nation states (SL4&5) is barely on the horizon."

https://ai-2027.com/

That's precisely where we are.

This is eerie. It's like a time traveler. The only delta is Anthropic is in the role of OpenAI.

gensym an hour ago | parent [-]

So you think Anthropic is using internal AI assistants to pull away from competitors and the leapfrogging we've seen over the last several years is now done?

That seems to me to be the most concrete and least obvious prediction in the quoted text.

I don't think that's happening. If that were generally accepted as true I would expect OpenAI to be unable to successfully IPO.

knollimar an hour ago | parent [-]

We wait for gemini 3.5 pro and cope?

MattRix 3 hours ago | parent | prev [-]

The idea that progress is “slow” in the AI space is absurd. These are some of the fastest growing products and companies of all time. The models are still improving a surprising amount.

dotdi 3 hours ago | parent | next [-]

It's not that absolute progress is slow, it's extremely slow compared to the predictions. It might be fast in absolute terms, but the "50% of coders will be obsolete by 2023" has been renewed every six months, and it's becoming increasingly clear that there's a real chance it might not ever happen.

mirekrusin an hour ago | parent [-]

„Coders being obsolete” is not a measure of AI capabilities. I see coders being more busy than ever before. I see people without coding knowledge getting more behind. The gap is widening, not shrinking.

Retric 3 hours ago | parent | prev [-]

I suspected you felt that way even though it hasn’t been my personal experience.

I’ve heard people say older models can’t do X, when I used that way etc. I suspect people are applying their own learning curve as part of their assessment of progress, you get better at writing prompts and it feels like the model improved.

Which is why I’m saying we need some objective metrics to judge predictions of actual capacity.

7777332215 an hour ago | parent | prev [-]

The AI companies are trying to manufacture the appearance of what they foretold before it all falls apart horribly.

fnordpiglet 4 hours ago | parent | prev | next [-]

It’s hard to take seriously a statement like this that’s grounded in “the last three years” when trends have tended to play out over decades. The fact the goal posts have moved from thousands to hundreds to decades to single digit years for massive transformation should give you a moment of pause in your bag saying.

I would however agree there are no experts. Not because of some prediction made on a short time scale not landing 100% but that there are literally no experts because expertise takes experience which takes time. There are no experts and no one knows what happens next. We are on the verge of where the foresight of science fiction effectively -ends-, the advent of AI is when things go a thousand possible directions and the stories stop there (sans a few like accelerando, but even then the story just plays out the end of thinking mass). No one knows what’s next, or when.

In fact I’d assert in many areas being discussed -it has already happened- and we don’t know it, and by the time we do it’ll be over. Not to be breathless, but there’s no reason to believe today some AI researcher somewhere didn’t build the first AGI and not be totally aware. And once they are there’s no reason to believe it’s going to be on the evening news or hacker news. By the time it’s ready for commercializing and disclosing it’ll be around for a while. Likewise with general purpose robots, autonomous weapons (btw already tested by Ukraine), etc.

bdamm 3 hours ago | parent | next [-]

Autonomous weapons are actually a really interesting branch of this and deserves a little more.

Yes, autonomous weapons were explored and were found to be poor performers compared to actual pilots. The breakthrough is in terminal guidance and dozens of other little techniques to get quality human control extended into the far reach of the battlefield. And of course, AI assistance in logistics and analysis. But actual autonomous weapons making any more of a choice beyond "something is moving, kill it" have been, at least for now, mostly a dead end.

This is because it's very difficult to economically load the rather sizable compute requirement into the compact one-use weapons, and of course reliable communications aren't assured either.

That will probably change some day, but for now, cheap automous command drones making battlefield analysis e.g. mapping out enemy movements from afar and launching cheap autonomous kamikaze drones is not a thing beyond occasional limited testing.

fnordpiglet 3 hours ago | parent [-]

You don’t need to load the compute onto the platform for autonomy, planning can be done remotely just like with human guidance. The latency is the same.

SJC_Hacker an hour ago | parent [-]

But if comms get jammed, how will the drone decide what to target ? For that you need inference, which means sizable compute.

tancop an hour ago | parent [-]

you can put the compute on a big expensive reusable control drone and send commands down with lasers. thats way harder to jam than any form of radio. if thats not enough try fiber optic like they do in ukraine.

fnordpiglet 37 minutes ago | parent [-]

There are also now drones with long spooling wires. Regardless, autonomous or not, connectivity to home is important.

I would note that a lot of drones are quite large too - small airplanes. They can carry more than enough hardware for autonomy. You can also have motherships doing planning and smaller kamikaze drones for combat.

These aren’t hard problems to solve, the harder problem is the reluctance to give over to automation. But that’s going to happen faster and faster.

al_borland 3 hours ago | parent | prev [-]

I said 3 years, because that’s how long ago ChatGPT was released to the public. Since then we’ve been told that all of us should be out of a job in 6 months, every 6 months, for those 3 years.

I agree that change happens on a longer timeline. This is why I’m so tired of statements like this…

“Within a couple of years, possibly much sooner…”

These “experts” are pulling timelines out of the sky, and these predictions are leading to reckless behavior from CEOs and executives which have a material impact on people’s lives. But they get clicks on their blogs and funding for their startup… I guess that’s all that matters.

frognumber 3 hours ago | parent | next [-]

Be a Bayesian, and they'll stop annoying you.

If you have a 5% chance of thermonuclear war each decade for 10 decades, you'll:

- Hear similar annoying statements

- They'll be true

With AI, we don't know if it's one week or one decade. This means we should assign probabilities and consider all possibilities, not get annoyed.

al_borland 3 hours ago | parent [-]

Assigning, and more specifically announcing/reporting on, all possibilities makes all of these predictions meaningless.

If I predict the world will end every single day from now until forever, I will most certainly be right eventually. That doesn’t make me an “expert” or someone worth listening to on the topic. That’s the playbook of a doomsday cult, not anyone that should drive world markets.

fnordpiglet an hour ago | parent | prev [-]

Ultimately we agree but for slightly different reasons. My assertion is there are no experts because there can’t be as not enough time passed for expertise to form. Further the rate of change is such that by time someone becomes an expert in some aspect, it’s been made irrelevant. Hence expertise in this space is unattainable at the moment and all expert advice is fraudulent.

raincole 2 hours ago | parent | prev | next [-]

> The predictions of these "experts"... last 3 years.

Which ones? Please be specific.

koe123 4 hours ago | parent | prev | next [-]

Expertise in naval gazing and science fiction writing is a prerequisite.

4 hours ago | parent | prev | next [-]
[deleted]
SpicyLemonZest 4 hours ago | parent | prev | next [-]

Do you have an example of a prediction they’ve made in the last 3 years that was drastically wrong? This is not my impression.

al_borland 3 hours ago | parent [-]

Do you think all white collar work will be replaced by AI in 18 months?

https://fortune.com/article/why-microsoft-ai-chief-mustafa-s...

Altman and Amodei recently hard to start walking back their earlier predictions.

https://fortune.com/2026/05/26/sam-altman-dario-amodei-walki...

SpicyLemonZest 2 hours ago | parent [-]

Again, do you have an example of a prediction that was drastically wrong? I don't think it's productive to speculate about which things might or might not come true in the next 18 months. There were people last year making fun of Dario for predicting that writing code would be automated in the next year.

al_borland an hour ago | parent [-]

From the 2nd link I posted:

> Anthropic CEO Dario Amodei, who once claimed AI could eliminate 50% of white-collar jobs, now says automation may actually expand the work people do.

Is pivoting from 50% elimination to actually expanding work not a drastic enough?

Do you think AI has eliminated writing code? I still write code every day. The AI is more a thing I ask questions and it gives me right answers about 40% of the time.

SpicyLemonZest an hour ago | parent [-]

Yes, I think AI has eliminated writing code. Everyone I personally know working in software stopped writing code some time between December and March. (It's true that AI continues to routinely make errors; if you've heard the term "agentic workflows", that's the standard strategy for mitigating the error rate by allowing the AI to check its own work.) That's why I think Amodei's January 2026 prediction that AI could eliminate 50% of entry level white collar jobs in 1-5 years remains plausible.

Your second article says something different, but this is because it's full of misquotes. The link supporting "50% of jobs" specifically says entry level, and the link supporting "reframed automation... not as a destroyer of jobs" has Amodei saying not that jobs won't be destroyed but that new jobs may be created to replace them. If AI moves sufficiently slowly to let that happen, which he explicitly cautions it may not.

bigstrat2003 an hour ago | parent [-]

> Yes, I think AI has eliminated writing code.

Then you are dead wrong. Anyone who gives a shit about doing a good job is still writing code.

SpicyLemonZest 25 minutes ago | parent [-]

No, that’s not accurate. I’m not sure what to tell you. It’s like hearing that no serious programmer uses Python, it’s so far from my experience and that of everyone I know in the field that I don’t know how to engage.

andsoitis 5 hours ago | parent | prev [-]

They have been wrong in a way that's bad: underestimating the speed and size of progress. So if the "experts" claim a timeline and magnitude, it would be safest to assume an even faster timeline and a bigger impact.

mikepurvis 4 hours ago | parent | next [-]

In fairness, they've been operating with a lot of built up cynicism from major breakthroughs that have been 3-5 years away for the past five decades.

m463 4 hours ago | parent | prev | next [-]

I wonder...

https://en.wikipedia.org/wiki/Technological_singularity

https://en.wikipedia.org/wiki/The_Singularity_Is_Near

3edd 4 hours ago | parent | prev [-]

[dead]