Remix.run Logo
spaceman_2020 7 days ago

At the moment, every AI service is dealing with capacity issues. Demand is much bigger than supply.

As long as that remains true, don't see how this bubble will be popped

serial_dev 7 days ago | parent | next [-]

I’m sure someone has numbers but I do wonder how many of their users pay and whether that covers the free users. It can still be a bubble even with high demand, if you are burning money to serve those users, because you hope one day you will rule the galaxy.

I don’t really have a strong preference, so I just use any service where I’m currently not rate limited. There are many of them and I don’t see much difference between them for day to day use. My company pays for Cursor but I burned through my monthly quota in a day working on a proof of concept that mirrored their SDK in a different language. Was it nice that I could develop a proof of concept? Yes. Would I pay 500 dollars for it from my own pocket? No, I don’t think so.

It’s like those extremely cheap food and grocery delivery apps, they made their food cheap, no delivery fees for a while… of course everyone was using it. Then, they started to run out of VC money, they had to raise prices, then suddenly nobody used them anymore and they went bankrupt. There was demand, but only because of the suppressed prices fueled by VC money.

JimDabell 7 days ago | parent | next [-]

> I do wonder how many of their users pay and whether that covers the free users.

It doesn’t cover the free users, but that’s normal startup strategy. They are using investor cash to grow as quickly as possible. This involves providing as much free service as they can afford so that some of those free users convert to paid customers. At any point they can decide not to give so much free service away to rebalance in favour of profitability over growth. The cost of inference is plummeting, so it’s getting cheaper to service those free users all the time.

> It’s like those extremely cheap food and grocery delivery apps, they made their food cheap, no delivery fees for a while… […] they started to run out of VC money, they had to raise prices

That’s not the same situation because that makes the product more expensive for the customers, which will hit sales. This isn’t the same as cutting back on a free tier, because in that situation you’re not doing anything to harm your customers’ service.

6 days ago | parent | prev [-]
[deleted]
digitcatphd 7 days ago | parent | prev | next [-]

Respectfully, starting one's argument with a factually invalid statement is not a good way to argue against a bubble. If by 'every' you are referring to the foundation model providers, this is not 100% of the 'AI service' market and even then, I would argue that a lot of this demand will need to be answered to by companies measuring ROI after the FOMO or unreasonable expectations get settled in and right now, my primary argument is this ROI is driven by speculation rather than empirical measurement.

I have spoken with many companies and nearly all of them, when speaking about AI, have gotten to the point they don't even make any sense. A common theme is 'we need' AI, but nobody can articulate 'why' and in-fact they get defensive when questioned. It is almost perfectly parallel to the 'we need blockchain' argument or 'we need a mobile app'. That isn't to say those are not useful technologies, but the rapid rise, steep decline, then gradual rise is a theme in tech.

disqard 6 days ago | parent [-]

James Mickens named-and-shamed this viewpoint, which he called "Technological Manifest Destiny".

Others have observed and pointed out his prescience before:

https://news.ycombinator.com/item?id=22364699

schlauerfox 6 days ago | parent [-]

alternately, they're too polite to say that to grow further they need to extract more value from labor and this is the biggest hope of that right now.

smallerfish 7 days ago | parent | prev | next [-]

> As long as that remains true, don't see how this bubble will be popped

That's what everybody was saying in February 2000.

rickydroll 6 days ago | parent | next [-]

I'm having bad flashbacks to 2008. Then I had a series of wallet-destroying medical events, went bankrupt, lost my house, got divorced, and have been dealing somewhat successfully with PTSD from that ever since.

Fortunately, this time around, I have a partner who is gainfully employed and has valuable skills that could be used in other companies. I am somewhat successful at consulting, plus a small pension. So the chances of going completely bankrupt are small, but not zero.

But oh fuck, I am having nightmares.

nyarlathotep_ 6 days ago | parent [-]

> I'm having bad flashbacks to 2008.

I was college age at the time, but yeah, this is how I recall it feeling.

There's seemingly a universal malaise around that comes up even in casual conversations.

Seemingly everyone is looking for a job with no success, every third story is about some sort of layoffs, and now even the press is starting to discuss the housing bubble.

I've been waiting for the proverbial other shoe to drop for some time now. Clearly, something's gotta give and the cracks are getting too large to ignore now.

6 days ago | parent | prev [-]
[deleted]
crinkly 7 days ago | parent | prev | next [-]

User retention is a more important metric. Everyone is silent there. That is directly tied to MRR, long term viability and ROI for investment. If those were positive I'd expect them to be crowing about it, but they aren't.

Capacity just means there is currently more demand than supply and that might be a number of negative factors driving that: users with no ROI (free users), too rapid growth, poor efficiency etc etc.

georgeplusplus 6 days ago | parent | prev | next [-]

What percentage of that capacity is being put towards useful things and what is being put towards entertainment? The products main selling point is to make us more efficient at our job and if it’s being primarily used as entertainment which everyone I know who uses an LLM besides programmers falls into that category, then I’d say the expected profit from them is a bubble.

izacus 6 days ago | parent | prev | next [-]

Are those services actually operating with profit to benefit from this demand? Or are they serving that demand while taking losses and showing unrealistically inflated metrics for demand?

lm28469 6 days ago | parent | prev | next [-]

I'd love to see the stats though, how much capacity is used for slop vs how much is used for actual productive tasks. If half of the capacity is used by bots on social medias and scammers it doesn't mean much for the economy

conartist6 6 days ago | parent [-]

Probably more than half is used to try to undercut good work with bad work

conartist6 6 days ago | parent | prev [-]

Well we'll keep scaling to meet the "demand".

Teachers are demanding not to do the work that is teaching. Lawyers are demanding not to do the work of lawyering. Engineers don't want to do coding and leaders don't want to steer the ship anymore unless it's towards AI.

Alllll the "value" is bullshit. Either AGI arrives and all jobs are over and it's eternal orgy time, or at some point the lazy ai-using losers will get fired and everyone else will go back to doing work like usual

DontchaKnowit 6 days ago | parent | next [-]

This kind of black and white thinking never pans out. The truth is always nuanced.

Eternal orgy time is not possible, will never happen. And if AI is useful, which it is, it will never be abandoned. Somewhere in the middle is the real prognosis

fuzzfactor 6 days ago | parent [-]

I'm not so sure about the middle. In many more things than ever, groups tend to cluster closer to the extremes.

It may "balance" around the middle, and expect it to be noticably different than now, even without much of an actual middle.

Or the middle could end up being just another group, maybe or maybe not the most prominent one.

georgeplusplus 6 days ago | parent | prev [-]

I can already see the campaign message for the Donald trump of 2125,

Make teachers great again.

xoac 6 days ago | parent [-]

Make center for kids who can’t read good and wanna learn how to do other things good too.

tagami 6 days ago | parent [-]

Volunteer at your local public library

xoac 5 days ago | parent [-]

Watch Zoolander

cindyllm 5 days ago | parent [-]

[dead]