Remix.run Logo
▲ jrflo 5 hours ago

I'm always shocked by the number of smart, technical people who seem to think that AI is going to crash and burn and go away. In 2025 AI got a gold at the IMO for the first time, a competition for high school kids. Now it's likely solved the biggest problem in math. There's no reason to expect progress to stop here, especially on domains highly amenable to RL.

▲DamnInteresting 3 hours ago | parent | next [-]

> I'm always shocked by the number of smart, technical people who seem to think that AI is going to crash and burn and go away.

I suspect that these "smart, technical people" you speak of have more nuanced views on AI than you realize. Myself, for example, a self-styled smartypants:

Like the dot-com bubble, I suspect that certain parts of the current AI landscape are unsustainable, and I suspect/hope that those specific features of AI will crash and burn, while other useful bits remain.

AI usage like we see in this post here--AI that assists with discoveries in math, medicine, genetics, astronomy--I think they're great, and I hope they will continue to advance human knowledge for the foreseeable future. They assist experts and professionals rather than replacing them.

In contrast, generative AI ("creative" AI writing, illustrating, music, etc) is a pox on civilization. It is industrialized low-effort plagiarism that harms artists' livelihoods, discourages new art, makes everything bland, and pollutes the world in multiple senses of the word. I hope it dies from a combination of negative sentiments, and too much real-world cost once token subsidies go away.

Then there are the AIs that do things like voice reproduction. They have some arguable positive uses (e.g., assistive technologies), but many negative ones (e.g., phone scams, replacing human narrators with copies of their own voices). I think we're better off without these apart from niche accessibility uses. I think it should be legal peril to reproduce a voice without permission.

Apart from helping with some cinema CGI, deepfakes and deepnudes seem like a net negative for civilization.

Knowledge-based AI like Google's AI search summaries might just have built-in expirations. I think people will burn out on being vigilant about hallucinations. And when the bulk of their training data is made by AIs, it'll be hard to prevent model collapse. The cost of human intervention might make it too expensive for the wide use we see today.

Coding AIs are a grayer area. I think it's highly problematic that they are basically open source plagiarism machines, but I begrudgingly believe that society will decide that the upsides outweigh the downsides in the long term. But I choose not to use AI in my own coding projects, and respect others who do the same.

▲jonahx 2 hours ago | parent | next [-]

My instincts are very similar on all points.

To push back, or share the self-pushbacks I grapple with...

> In contrast, generative AI ("creative" AI writing, illustrating, music, etc) is a pox on civilization. It is industrialized low-effort plagiarism that harms artists' livelihoods, discourages new art, makes everything bland, and pollutes the world in multiple senses of the word. I hope it dies from a combination of negative sentiments, and too much real-world cost once token subsidies go away.

While this summarizes my feelings on the current versions (which, say, are roughly at or below the math olympiad stage in writing, video, etc), what happens when they actually become good? Meaning, an AI show that was actually as good as The Wire? To the point you couldn't tell the difference without being told?

I really want to say that even then it won't be the same, because the human provenance is essential to the art, but if I truly couldn't tell the difference...

▲Planktonne 2 hours ago | parent | next [-]

> While this summarizes my feelings on the current versions (which, say, are roughly at or below the math olympiad stage in writing, video, etc), what happens when they actually become good? Meaning, an AI show that was actually as good as The Wire? To the point you couldn't tell the difference without being told?

But here we're dipping into science fiction again. This is not currently the case, and we seem a long way from it.

▲jonahx 2 hours ago | parent [-]

> and we seem a long way from it.

We're dipping into prediction. But we have the (seemingly relevant, but not necessarily so) data point that we're in the same situation w.r.t. writing/art as we were w.r.t. to math a couple years ago...

▲DamnInteresting 2 hours ago | parent | prev | next [-]

> what happens when they actually become good? Meaning, an AI show that was actually as good as The Wire? To the point you couldn't tell the difference without being told?

Perhaps this comment will make me look silly one day, but my guess is that we'll eventually get there, and a handful of AI-generated productions will truly shine. But "as good as" is an important phrase. Because current-generation AI is trained on existing art, it won't be pushing many envelopes, it'll mostly be remixing what we have, and that will grow stale.

After a few breakout hits with broad shared appeal, I think the novelty will wear off, and AI produced TV and cinema will be too resource-intensive to remain as a profitable going enterprise. There will likely be a short window of hyper-personalized media that will seem very exciting, until we grow weary of the isolation of it. For many people, half the fun of watching a thing is discussing it with other humans, and today's streaming media landscape already leaves many people unmoored from that shared experience.

There is also the question of intentionality. When AI creates that show as good as The Wire, is that because AI has something to say about the human condition? If not, what's the point? If so, should we be paying attention to what AI wants us to pay attention to?

▲SpaceLawnmower an hour ago | parent | prev [-]

So what if AI slop wasn't slop? If you care about the details and the values behind your work enough to make it actually good, you won't use gen AI or use it invisibly because it concedes control of the details.

If you believe that using the authenticity of your own experience in your art will become vanish from how people value art then yeah we're headed for a future where AI rules. I really hope that that isn't the case.

▲montagg 2 hours ago | parent | prev | next [-]

I like your framework of separating use cases, mostly to evaluate how it will change in those specific areas, but I think you can evaluate capabilities fairly simply: I like to separate AI that depends on giant data centers and huge power draw from the kind that doesn't (not always local)—basically expensive vs cheap.

The expensive stuff isn't sustainable. Not yet. It probably will be, who knows when. I suspect it will be eventually because there's good money in it.

Here are the claims I find highly suspect based on the above:

- Anyone making claims that require expensive AI and attaching it to a short-term timeframe

- Anyone saying highly capable AI is impossible in the long-term

- Anyone saying these specific companies will be the winners—there is absolutely no moat for these models

I personally think anyone claiming something like super-intelligence or something approaching what we might consider sentience even in the next 5 years is suspect as well. I would not take the bet myself, but I would also not bet against it. The main reason is power: there's literally only so much power we can generate, so much societal disruption due to creating the infrastructure we can absorb (not to mention the societal disruption due to the tech itself), so its capability to self-improve is going to be highly constrained.

So far, we see increases in capabilities also increase power usage, I believe linearly. So, we're not seeing increases in efficiency that will make this easier to absorb. There's a ceiling, it won't go up quickly, so I think actual sentient-like AI capabilities are quite farther out than promoters think. Not impossible! I think it's more like a decade+ of maturation of the software and hardware stack—which isn't really that long in the grand scheme of things but longer than most people are betting.

▲jrflo 3 hours ago | parent | prev | next [-]

They may have more nuanced views for sure, but nuance is famously lacking from most online discussions unfortunately. I would love to see more of it surface!

▲empath75 3 hours ago | parent | prev [-]

> Like the dot-com bubble, I suspect that certain parts of the current AI landscape are unsustainable

It's possible to believe that _almost all_ AI companies will go bankrupt while still believing it is a massively important world changing technology.

▲softwaredoug 4 hours ago | parent | prev | next [-]

My experience on teams is there are the high agency AI adopters. Management likes this group. Then there’s what management would characterize as those not adapting (or adapting enough). This is the group getting laid off / not advancing in the environment. And this group is particularly bitter about AI disrupting an otherwise stable career, with wishful thinking they’ll be able to go back.

▲Seattle3503 3 hours ago | parent | next [-]

I've seen the first group vibe up garbage and dump maintenance on the second group. It may be unfair to blame AI for that when management is ultimately responsible, but that's what a lot of people are doing. In their defense, management is being mislead by AI hype men who are saying AI is so intelligent it shouldn't be making dumb mistakes.

▲jeremyjh 2 hours ago | parent [-]

Agreed, its more complicated than GP describes. There is clearly lots of value, but there are also lots of poorly led organizations creating a mountain of problems for themselves. We are all still figuring out what AI really means just for software development, which is the most useful economic activity it can do by an enormous margin.

Human minds are still needed to understand many things related to developing correct software, especially in business domains. There is still no AI running a profitable business, because that is not a verifiable task that can be scaled in RL like math or coding. So extrapolating from a math proof that no one can understand to a economically useful agents taking over most jobs is quite suspicious.

What is changing now is RSI truly beginning to happen. Much of ML is a verifiable task that can be scaled, and a lot transfers from general coding as well. Leading researchers are predicting their own obsolescence as early as next year, and that is something I take seriously, though I cannot judge the likelihood myself.

As improvement accelerates, we may see generalization happen at a scale that means we don't need RLVR for every profession. We've been surprised by it before.

▲tempestn 2 hours ago | parent [-]

> because that is not a verifiable task that can be scaled in RL like math or coding

Is it not, or are the feedback loops just longer? I could imagine being able to build a pretty good simulator of business operation for various kinds of businesses. (Some decent ones already exist as games.) From there, if you can build a good enough simulation, I can't see why you couldn't RL it.

Of course it's easier said than done to generalize it to the real world, where the possibility space is large. But I don't necessarily see an impediment to getting there eventually.

▲jeremyjh 2 hours ago | parent [-]

The feedback loops are quarters and years, so no you cannot scale it like you can scale math or coding. This is the reason we are seeing the most progress in those domains. Even ML is harder to scale because test runs are expensive and consume significant calendar time, so research "taste" is still important.

▲Seattle3503 an hour ago | parent [-]

A full simulation would be, but I suspect even a partial simulation of evolving a software project though multiple "checkpoints" over a quarter would improve model performance

▲xvector 3 hours ago | parent | prev [-]

Honestly, the second group kind of brought this upon themselves. You cannot survive in tech without having an open mind and moving fast.

▲699 3 hours ago | parent [-]

[dead]

▲lordnacho 5 hours ago | parent | prev | next [-]

I actually asked a guy who got an IMO gold what he thought about it, and he's happy to concede that AI works. He used to be my go-to guy for those kinds of problems when I came across them. Now you can actually get it to solve those things on your standard plan.

▲throwaway384034 5 hours ago | parent | prev | next [-]

Level of intelligence doesn’t matter if it is not applied to truth searching and instead to reasoning backwards from personal wishes.

▲cman1444 5 hours ago | parent | next [-]

Isn't this post an example of the former?

▲throwaway384034 4 hours ago | parent | next [-]

> I'm always shocked by the number of smart, technical people who seem to think that AI is going to crash and burn and go away

That’s what I am responding to.

▲ 5 hours ago | parent | prev [-]
[deleted]
▲mvkel 4 hours ago | parent | prev [-]

Define truth

▲wofo 4 hours ago | parent [-]

42

▲nancyminusone 4 hours ago | parent | prev | next [-]

Parts are already disappearing if not gone already. If not by lack of profit, it will be by liability, overuse and moderation. Filters are being put up, bans in place, services restricted.

Just the other day a model helped me root an old android tablet. Will that still work in 5 years? I don't really have great confidence.

▲kridsdale1 3 hours ago | parent [-]

Yes, as long as it’s legal for you to buy a GPU.

▲fsnovask 4 hours ago | parent | prev | next [-]

>I'm always shocked by the number of smart, technical people who seem to think that AI is going to crash and burn and go away.

The tech industry cultivated that reputation though. People were just acting rationally by being more skeptical of even larger claims than they were making before.

▲rfgplk 5 hours ago | parent | prev | next [-]

Because they're _desperate_ to keep their social standing. That's literally all there is to it. The same occurred during Enlightenment and the industrial revolution. A small upper echelon of society (the church or aristocrats respectively) were deemed worthy enough to possess knowledge and thus to belong to an upper strata. The same story can be seen pretty much in every civilization btw (Greeks/India/China/Japan etc). When the masses started gaining access to this knowledge there was _massive_ pushback, even armed revolutions in certain cases.

What's happening today is that anyone and everyone can have access to superintelligence. Anyone with access to an LLM effectively is, simultaneously, a world-class diagnostician, engineer, architect, musician, mathematician... you get the point. This will necessarily lead to a post-scarcity society, since everyone knows everything and will be capable of producing anything.

▲bodge5000 5 hours ago | parent | next [-]

> This will necessarily lead to a post-scarcity society

I wish I shared this optimism, unfortunately that upper echelon of society is the one which currently controls the superintelligence. Everyone may have access to it, but they own it.

▲atonse 4 hours ago | parent | next [-]

I would share your concern if there wasn't such a thriving ecosystem of open weight models. And they're usually about a 6 months to a year behind.

Still, as of now, while I use AI for everything I do (mostly Claude but also ChatGPT), I don't use any open weight models (probably more of a mental block at this point), but I do see them as a necessary counterweight to this potential power imbalance.

▲WhyIsItAlwaysHN 4 hours ago | parent [-]

Where are you going to run these open models? Natural resources are controlled by this upper echelon too.

▲OroPla 3 hours ago | parent | next [-]

Most households own a car which even if you go used has a price tag of around $20k if you want something average. It wouldn't be much of a stretch to see a future where every household owns a $20k AI computer. Or two. If you are fancy you own a $100k AI computer.

However, since there is an ongoing war on general computing it wouldn't surprise me if instead people get locked into subscriptions.

▲solyin 3 hours ago | parent | next [-]

Shit people be telling ChatGPT isn't protected by law. You get into any trouble, your chat history gonna be gone over with a fine tooth comb. Some of the masses gonna realize that and gonna want a sever rack at home instead.

▲vel0city 2 hours ago | parent | prev [-]

I bought a 2000 Honda Accord V6 from a friend for $3k a long time ago. I drove it for several years, adding probably another 90,000mi to it. It didn't need much maintenance during that. It's still kicking from what I understand. An incredible car, I'm a little sad I parted with it.

I still think of the economic benefit I got from that car. It drove me to university classes. It drove me to work. It took me to see a total solar eclipse. It brought me to see distant family regularly. I went on a lot of road trips on it. For roughly $3k of capital costs.

I look at most expensive things and size them up as "how many Accords is this?"

Almost 7 Accords is a lot.

▲ 4 hours ago | parent | prev [-]
[deleted]
▲rfgplk 4 hours ago | parent | prev [-]

For now. Open weight models are effectively only lagging ~6 months behind the frontier.

▲dontlikeyoueith 4 hours ago | parent | prev | next [-]

> This will necessarily lead to a post-scarcity society, since everyone knows everything and will be capable of producing anything.

A post-scarcity society requires MATERIAL abundance in the hands of everyone.

All the material is controlled by ~100 mentally ill people who would rather kill us all than share.

▲sigbottle 4 hours ago | parent | prev | next [-]

I don't get why academics get the shaft every time. These labs are worth trillions of dollars while your average professor has to deal with 18 year old shitheads and gets paid 50k a year. Like what?

▲Routine8502 3 hours ago | parent | next [-]

Anti-intellectualism. The median AI booster resents that there is a class of people that had to work to become proficient in something, and wants effort to become irrelevant so their lack of investment in it appears to no longer be a failing.

▲tavavex 4 hours ago | parent | prev | next [-]

AI boosters love to frame the trillion dollar corporations as the real victims. War is peace, freedom is slavery, scraping all known data and refusing the share the fruits ("distillation attacks") is democratization, people who are losing their jobs to megacorporations with lots of compute power are the real sheltered elites who are mad because they're hypocrites.

▲kridsdale1 3 hours ago | parent | prev [-]

That professor is free and highly encouraged to navigate their web browser to Anthropic’s careers page.

▲trallnag 2 hours ago | parent [-]

I don't get what you are trying to say. We will be all working for Anthropic?

▲RandomLensman 4 hours ago | parent | prev | next [-]

How would an LLM make me a world-class violin player? If scarcity is from needing real "stuff" (incl. time), then knowledge alone might not change that scarcity.

▲solyin 2 hours ago | parent [-]

Same way as a human would? By watching you (upload video) and listening to you (upload audio) and talking to you about your technique (text to speech). It's obviously no substitute for the real thing, but for $20/month, it's a lot more accessible to more people than a human instructor would be.

▲techpression 4 hours ago | parent | prev | next [-]

We don’t have access to knowledge, we have access to information. Knowledge requires processing information and that just doesn’t happen any more.

A post-scarcity society is not possible without first wiping out society. If everyone has everything then everyone has nothing. And of course, natural resources are actually limited, and those power LLMs.

▲bigstrat2003 4 hours ago | parent | prev | next [-]

I'm sick and tired of seeing people go "AI skeptics are just afraid of not being important". That's complete bullshit. We are skeptical because we can see, with our eyes, that the claims of AI boosters continue to be false time and time again. The simple empirical fact is that LLMs can't actually do a good job at the things people claim they are good at, and the industry lies through its teeth about said capabilities. So we are skeptical.

▲ 2 hours ago | parent | next [-]
[deleted]
▲qlte 3 hours ago | parent | prev | next [-]

Yep, argument by psychoanalysis is a convenient way to disregard any stated disagreements as really just rationalization by weak/scared/lazy/depressed/etc people.

▲senordevnyc 3 hours ago | parent | prev [-]

Wild thread to be making an “LLMs can’t do what’s claimed!” last stand…

▲Planktonne 2 hours ago | parent [-]

AI still can't do a lot of what's claimed. This thread is an example of it being able to do one admittedly-impressive thing, but it's still nowhere near living up to all the promises.

▲SubmarineClub 4 hours ago | parent | prev [-]

> Anyone with access to an LLM effectively is, simultaneously, a world-class diagnostician, engineer, architect, musician, mathematician... you get the point. This will necessarily lead to a post-scarcity society, since everyone knows everything and will be capable of producing anything.

It’s hard to take you AI-hype men seriously when you are this ravingly delusional.

▲vagab0nd 5 hours ago | parent | prev | next [-]

"If you are smart, why can't you predict the future?"

▲jrflo 5 hours ago | parent [-]

It's not an ability to predict the future, but the reluctance to step back and look at the trendline rather than saying "But it still can't do X, Y or Z!".

▲mcphage 4 hours ago | parent | prev [-]

> There's no reason to expect progress to stop here

Well, the amount of money and resources it took to get here is a reason. I don't think the resources exist for another order of magnitude increase, given the strain on our economy and society we're already under due to AI.

▲allturtles 4 hours ago | parent | next [-]

The frontier models are getting cheaper as they are getting more powerful [0]. It's really not going to crash. I wish it would, for the sake of humanity.

[0] https://epoch.ai/publications/the-plunging-price-of-thought

▲GrollingGrakbor 3 hours ago | parent | next [-]

As does every technology, but websites are not a few million times faster than they were when they were invented, and your computer does not boot a few billion times faster (quite the opposite...).

Reality is extremely chaotic.

▲mcphage 2 hours ago | parent | prev [-]

I was thinking more about the cost in time, power, hardware, and data to train the models, not the price charged to use the models. I don't think it's going to crash, either—but that doesn't mean that progress will increase forever.

▲orangecat an hour ago | parent | prev [-]

We are well past the point where massive changes are guaranteed even if LLMs immediately and permanently hit a wall in capabilities.