| |
| ▲ | minraws a day ago | parent | next [-] | | If the margins aren't as high then there will be a repricing for all the massive cloud companies, which means several trillions worth of valuations to be cut from the companies. AWS/Azure/GCP/Oracle/SpaceX/etc neoclouds... are worth a combined 10+Trillion. That going down by 50-70% is going to be insane. | | |
| ▲ | benoau a day ago | parent | next [-] | | That would only happen if they need to invest like this forever, otherwise it's just a short-term dent in their margins while they re-calibrate. | | |
| ▲ | ody4242 a day ago | parent | next [-] | | This is a good chart that shows historical CAPEX spending. Hyperscalers have been through a couple CAPEX cycles like this, they all know what they are doing. https://eco3min.fr/en/big-tech-capex-revenue-ratio-quarterly... | | |
| ▲ | chrisweekly a day ago | parent [-] | | Thanks for sharing.
Agreed it's a good chart. But I draw a different conclusion. M$ looks pretty iffy: capex/revenue 10% -> 37% in the last 5y, scary trajectory. |
| |
| ▲ | LunaSea a day ago | parent | prev [-] | | Why? GPUs are replaced every 3 to 5 years. This is going to be an ongoing operational cost forever. It will probably increase more if larger models require bigger VRAM sizes. | | |
| ▲ | mcbuilder a day ago | parent | next [-] | | We have probably hit a limit to scaling LLMs through raw parameter count alone, at least we're not seeing the exponential pace. I personally think we'll end up with a nice sigmoid curve plateauing in the sub 10T parameter regime. The amount of tokens processed (in inference) is increasing exponentially though (I've been following open router usage stats for years and it's always been exponential). We will of course make technological advances in hardware efficiency, and model parameter efficiency, but I think a much more plausible future is that VRAM needed for loading and serving individual models will slow down or even stop. We will need more chips, and more power, as demand continues to grow of course, but the operational lifetime of GPUs today will be a lot longer than the SoTA cards from 5 years ago. | | |
| ▲ | CuriousSkeptic 19 hours ago | parent [-] | | > We have probably hit a limit to scaling LLMs through raw parameter count alone, at least we're not seeing the exponential pace. Source? |
| |
| ▲ | ody4242 a day ago | parent | prev | next [-] | | They are building new datacenters for the AI demand, so around half of this CAPEX is not for the GPU-s, and those will not be replaced every 3-5 years. Also, TPUv2 was introduced in 2018, and still not completely retired in all regions, from accounting pov, it has been written down to 0, but they are still working. | | |
| ▲ | lokar a day ago | parent [-] | | The cost of the land, building, mechanical equipment, etc is a very small fraction of the total cost of a DC. | | |
| ▲ | ody4242 a day ago | parent [-] | | The upfront cost of facility is ~30%, network infra 10-15%, land/utilities is small percentage, power could be significant for an AI DC. The servers are ~50-60% only. | | |
| ▲ | lokar a day ago | parent [-] | | That was not my experience, but that was pre-Covid |
|
|
| |
| ▲ | benoau a day ago | parent | prev [-] | | That cost has always been there and allowed for their lucrative margins. It's the upfront cost of building/populating their datacenters (many more than before) that is eating those margins. | | |
| ▲ | minraws a day ago | parent [-] | | I mean the issue is scaling, the worlds for cloud never kept getting bigger and bigger and compute scaling had stopped a while ago in the CPU space. With AI every new generation with both massive hardware and software stack changes from Nvidia makes prior chips extremely inefficient to run, basically we are comparing an ASIC industry to a general purpose compute industry where all work loads are the same shape and size and so on. Margins for ASIC based mining companies or ASIC solutions providers were never high, Optane and other weird solutions are niche and great for a specific category or moment in time, but they become obsolete pretty quickly. The fear is we don't know if this Capex can stop.
The worst type of fear is if this Capex will stop then what? Someone is very overpriced in this market, the cloud companies, the hardware providers or both. I don't see how we reconcile this without a massive wave of repricing, ofc markets can stay irrational and we don't see the actual books but AI doesn't have so much revenue. Suddenly the AI token/cloud revenue won't 100x in a year or two... Especially when intelligence will continue to get cheaper, the margin compression is a massive risk. All the data centers for hyper scalers were a miniscule part of their story the real moat was the software layer on top otherwise Hetzner would be priced like an Amazon as well. Something is shaky with this market I don't know what it's very opaque even as an insider working on for big tech and startups. I have no clue who falls first and which bottleneck cracks but there is not enough revenue for tokens, we will see a strong 2-3x growth in the next few years, from here which is absurd, but it's not enough, not nearly enough. If the capex keeps high and increasing. Ofc they can stop the capex and the otherside gets repriced it's not like nvidia, micron and co aren't worth trillions. |
|
|
| |
| ▲ | rjdndmndnd a day ago | parent | prev [-] | | [dead] |
| |
| ▲ | drumhead a day ago | parent | prev | next [-] | | And then they'll be valued like more normal companies as well. Which will mean a drastic re-rating. | | |
| ▲ | gowld a day ago | parent [-] | | Google's P/E is 25, which normal for "tech", and comparable to S&P overall current, average, which is 50-100% of historical average. |
| |
| ▲ | epolanski a day ago | parent | prev [-] | | Also all these companies went from buybacks to dilution and debts again. |
|
| |
| ▲ | InsideOutSanta a day ago | parent | next [-] | | The problem is that the dramatic improvement in capabilities is not translating to a dramatic increase in revenue. | | |
| ▲ | erwald a day ago | parent | next [-] | | "Anthropic and OpenAI generate a lot of revenue with relatively few employees – an estimated $9M and $5.5M in revenue per employee (RPE), respectively. If either company were to go public, it would have a higher RPE than any public tech company on Forbes’ Global 2000 list." https://epoch.ai/data-insights/revenue-per-employee-ai-compa... | | |
| ▲ | wolttam a day ago | parent | next [-] | | Each one of those employees maps to several fold times more spending on compute. | | |
| ▲ | erwald 2 hours ago | parent [-] | | True, but the comment I was replying to was about revenue, not costs |
| |
| ▲ | yunwal a day ago | parent | prev | next [-] | | The guy who sells $20 bills for $10 also generates a lot of revenue | | | |
| ▲ | TheOtherHobbes a day ago | parent | prev | next [-] | | They've replaced employees with compute, so RPE is irrelevant. | | |
| ▲ | erwald 2 hours ago | parent [-] | | The point is that revenue is large and growing quickly, which is what the comment above mine denied |
| |
| ▲ | InsideOutSanta a day ago | parent | prev | next [-] | | The revenue needs to be way, way higher than this to warrant the investment. | | |
| ▲ | erwald 2 hours ago | parent [-] | | Maybe, but that's a different claim. You wrote that the improvements are "not translating to a dramatic increase in revenue", but going from about $1B to about $30B run rate in 16 months seems like a pretty dramatic increase to me! |
| |
| ▲ | serial_dev a day ago | parent | prev | next [-] | | How is RPE relevant if they are spending hundreds of billions on compute and data centers? | | |
| ▲ | erwald 2 hours ago | parent [-] | | It's relevant to the claim I was replying to, which was that revenue isn't growing, not to the question of whether the spending will pay off |
| |
| ▲ | Ekaros a day ago | parent | prev | next [-] | | So they can add employees endlessly? And still make same revenue? Increasing employees only scale so far at those numbers. | | |
| ▲ | erwald 2 hours ago | parent [-] | | No, I wasn't claiming that revenue scales with headcount, though it probably does to some extent. The point is that these companies' revenue is large and growing quickly, which is what the comment above mine denied. |
| |
| ▲ | dirkc a day ago | parent | prev | next [-] | | Isn't that just saying CapEx is a bigger part of their costs as if that is a positive thing? | | |
| ▲ | erwald 2 hours ago | parent [-] | | I wasn't saying anything about costs, only that revenue is growing quickly |
| |
| ▲ | toomuchtodo a day ago | parent | prev | next [-] | | This assumes they do not have to increase prices to be profitable, and that they will continue to have customers when customers can switch to open models at similar performance. As an analogy, Uber could crank up rates after the VC growth play was over to stoke revenue and profits because they have a duopoly with Lyft. LLM consumers can switch to Kimi models fairly trivially today, and whatever the frontier open model landscape looks like later. Model training and development is expensive, self hosted inference on open models not so much. https://www.wheresyoured.at/the-openai-bubble/ has the math. (a component of my work is currently building scaffolding so our organization can swap out commercial inference providers for on prem inference infra to derisk against the eventual rug pull when the math gets icky for LLM providers, while consuming as much subsidized tokens as we can until then, when it makes sense to use tokens for work) | | |
| ▲ | erwald 2 hours ago | parent | next [-] | | Those seem like reasonable questions about future margins and moats, but I was making the narrower point that revenue is in fact growing quickly, contra the comment above mine | |
| ▲ | lenerdenator a day ago | parent | prev [-] | | The question will be whether customers can switch. Can you install a near-SOTA model on a cluster in a data center? Of course. Compliance and operations are the sticking points. I work in healthcare IT, and it's amazing how tight the data compliance requirements are. I can't have someone in Canada look at prod data. If we told hospitals that we were handing off PHI/PII to Chinese models, they'd end our relationship due to the long history China has of hacking Western networks and computers. They don't care how open and cheap things are. Then, you have to keep up-to-date on the latest technology and right-size things in a very fluid market. If you sign a contract for hosting the model on a data center that's running what the SOTA is now in hardware, and someone comes through with a data center hardware or software product that makes that data center contract a disadvantage (maybe it's too expensive and the other party won't budge on the price), you might have to factor that into your offering's price, and that could put you at a disadvantage in your marketplace. Google, MS, etc. all want to leverage the cloud model to make this be less of an issue for you, for a price. They have the ability to update you with the SOTA stuff in the data centers, because they're the ones driving that SOTA. They can say they host in the US and develop most of their stuff in the US. Will that be enough of a moat? Probably not for the levels of spending that are happening now, but over the long term, probably. | | |
| ▲ | zdragnar a day ago | parent | next [-] | | How long will a SOTA model be necessary? If day to day work can be achieved on an open weight model, the most evaporates overnight. Look at any computer in a big company. It isn't the fastest on the market, nor will it have the most RAM or largest monitor or fanciest keyboard. It is good enough at a good enough price point. Once it becomes possible and cheaper to host your own good enough open weight models, with all the benefits of keeping data internal to the company, then the big providers are cooked, so to speak. | | |
| ▲ | lenerdenator 21 hours ago | parent [-] | | > How long will a SOTA model be necessary? If day to day work can be achieved on an open weight model, the most evaporates overnight. Depends on the advantage it gives people and marketing of that advantage. You'd be surprised at how overpowered the average workplace laptop is. Each company I've been at has had at least some people who do non-technical roles using high-end hardware. Why? Because the account executive wants the fast machine and they get what they want. You can apply the same to GenAI. Humans are notoriously bad at estimating actual needs when it comes to resource consumption. Best to have it and not need it than need it and not have it, especially if your competition just shelled out for SOTA. And that's not even taking into consideration regulatory and customer concerns about where the AI you're serving requests with came from. | | |
| ▲ | zdragnar 21 hours ago | parent [-] | | Execs getting what they want doesn't mean they let everyone have the same thing. It's far more likely that everyone else is using lesser equipment. We have already seen tech workers at big name companies get whiplash from "leaderboards showing people using the most tokens!" as a good thing one month to being pressured to using fewer tokens a month later. | | |
| ▲ | lenerdenator 18 hours ago | parent [-] | | > Execs getting what they want doesn't mean they let everyone have the same thing. It's far more likely that everyone else is using lesser equipment. You'd be surprised. I've seen people request upgrades and get them. Not even execs, just employees. Even the average devices are probably overpowered these days. Chromebooks could do the vast majority of work in a corporate environment. Try getting workers to accept them, though. Regardless, there are probably enough reasons to use proprietary Western AI for the time being, particularly in regulated industries, that poop won't completely hit the fan. Particularly if the CTOs start searching the phrase "Operation Aurora". > We have already seen tech workers at big name companies get whiplash from "leaderboards showing people using the most tokens!" as a good thing one month to being pressured to using fewer tokens a month later. Indeed. What do you do when you want a group of people to do something that they'd be otherwise adverse to doing at all? You rank them on it and let them get in a competition over who can do it the most. That's what tokenmaxxing was about: getting people to use the AI at all. Now that the people are using AI, we move onto another objective, which is getting them to use the tokens efficiently. The trick is measuring that efficiency. |
|
|
| |
| ▲ | toomuchtodo a day ago | parent | prev [-] | | My primary role is cybersecurity in a regulated entity in a regulated industry, I am highly confident it is straightforward to do so based on work accomplished in only a couple of weeks. Stand up a router, stand up a Kubernetes cluster if you don't have one, stand up the necessary VMs and compute for serving inference. Two pizza team, in my experience. Customers can switch (although we can argue the speed and pain of doing so), and the speed at which they do will be a function of cost efficiency and demonstrable value (imho). A recent example of this is Broadcom and VMware [1], for example. When motivated, it can be done. If there is no objective, measured value being delivered, the spend will be cut. If the value delivered is measured, it will be enabled at a lower cost through cost optimization measures (ie self hosting) [2]. This is all to say: there is no moat, the revenue of inference providers is volatile and not assured in any measure. Caveat emptor. [1] https://hn.algolia.com/?dateRange=all&page=0&prefix=false&qu... [2] Microsoft considers replacing ChatGPT and Claude with Kimi K3 to save $600M - https://news.ycombinator.com/item?id=49022984 - July 2026 | | |
| ▲ | Foobar8568 a day ago | parent | next [-] | | Meanwhile, in real companies, you have to wait 2 months or more to access an API endpoint in preprod. To setup a cross business kubernetes cluster will take 2 years with unknown results. On Cloud, in Switzerland, you need to call Microsoft when you need new resources, so much for agility and minute infrastructure provisioning, and I heard the same for AWS. | | |
| ▲ | brazzy a day ago | parent | next [-] | | > Meanwhile, in real companies, you have to wait 2 months or more to access an API endpoint in preprod. > To setup a cross business kubernetes cluster will take 2 years with unknown results. Do you seriously believe those times will not go down 95% if the CEO pushes for it to get done yesterday because it will save the company millions in expenses? | | |
| ▲ | toomuchtodo a day ago | parent [-] | | You get it. Given sufficient incentives, processes and systems become potentially more malleable, and hard requirements can become optional. Speed is a function of appetite, will, and resources. |
| |
| ▲ | a day ago | parent | prev [-] | | [deleted] |
| |
| ▲ | raducu a day ago | parent | prev | next [-] | | > Stand up a router. it has to be some amazing router and while the models are open-weights, the knowhow to run them efficiently surely is not? | |
| ▲ | lenerdenator 21 hours ago | parent | prev | next [-] | | There's a difference between "It's straightforward to do" and "I can convince a customer to sign a contract allowing us to do it." If the second one were as easy as the first, I wouldn't have to be online at 9:00 to deploy stuff to prod tonight; the team in India would handle it. But customers write into the contracts that only US-based employees interact with prod systems. No amount of cajoling will get them to change their minds; they have data sovereignty, international telecommunications treaties, and HIPAA compliance to worry about. So I'll be pressing buttons tonight. Could you swap out Anthropic or OpenAI or Google or whoever's models for Kimi? Yes. They're like other software these days, they're modular. What isn't modular is regulatory and geopolitical concern. | |
| ▲ | WarmWash a day ago | parent | prev [-] | | Good luck explaining to an exec that the locally hosted Chinese model definitely doesn't have a backdoor or hidden trained-in intentions. Meanwhile the cost/benefit analysis doesn't move much even if you are paying 2x for tokens, and you don't need anything on prem. |
|
|
| |
| ▲ | icedrift a day ago | parent | prev | next [-] | | Revenue isn't profit though. Anthropic is already profitable OpenAI financials have looked doomed for the past year | | |
| ▲ | erwald 2 hours ago | parent | next [-] | | Right, and the comment I replied to was about revenue, not profit. (That said, while I don't think Anthropic is already profitable, it reportedly expects its first operating profit later this year.) | |
| ▲ | Insanity a day ago | parent | prev | next [-] | | I’ve never seen anything point to Anthropic being profitable. | |
| ▲ | lightbendover a day ago | parent | prev [-] | | [dead] |
| |
| ▲ | throwaway27448 a day ago | parent | prev [-] | | Ah well we just need to convert our entire economy into an MLM and then I'm sure we'll be set | | |
| ▲ | erwald 2 hours ago | parent [-] | | Lots of people paying for a product they use is more or less the opposite of an MLM |
|
| |
| ▲ | DiscourseFan a day ago | parent | prev | next [-] | | The technology is too hard to capitalize on. It’s far more democratic than, say, an iPhone, or a search engine. Anyone can download a model to their computer and start toying with it, how do you profit off of that? Even if everyone was constantly tokenmaxxing (which we cannot, since the process gets fucked up if you let it run entirely on its own), it probably still wouldn’t be marginally profitable. | |
| ▲ | thewebguyd a day ago | parent | prev | next [-] | | Ans so far, the dramatic improvements have come with an increase in API costs. Even if, hypothetically, Fable or a Fable-class model could seriously replace some headcount, it'll only gain further traction of it's actually cheaper than hiring humans. $50/MTok is expensive. Wouldn't be unreasonable to expect somewhere between ~$3k-$5k/month/developer in spend. Cheaper than a Junior in the HCoL areas (in the US), but not much cheaper in lower-to-average COL areas. Most acceleration will come from having the headcount + giving said headcount $3k-$5k/month in token budget, so now it just becomes a very expensive dev tool rather than a headcount replacement tool. The idea that a $30k/year API bill will replace 2 $100k developers falls part outside of SFC/NYC. No CFO of a mid-market company in a LCOL area is signing off on $3k/month/dev API bills. They'll just hire juniors and cap their spend at $200/month. | |
| ▲ | ac29 a day ago | parent | prev | next [-] | | The article notes Google Cloud revenue grew 82% YoY | | |
| ▲ | paxys a day ago | parent | next [-] | | How much did Google spend to get that increase? | |
| ▲ | inigyou a day ago | parent | prev [-] | | Why do people choose the cloud with a history of randomly deleting billion-dollar accounts? | | |
| ▲ | manarth a day ago | parent [-] | | UniSuper? (The claim felt so wild I wanted to check, and indeed, the private Google Cloud for the $125bn Australian pension fund was accidentally deleted by a provisioning misconfiguration. Any others?) | | |
| ▲ | zdragnar a day ago | parent | next [-] | | IIRC, the files for Toy Story 2 were accidentally deleted during production, and the film was only saved because someone on maternity leave had a backup at home. Turns out you can fuck up self hosting too. | |
| ▲ | inigyou a day ago | parent | prev [-] | | Yes, Google randomly deleted UniSuper for basically the same reason they randomly ban individual customers: they don't care. Relying on them for anything is a huge mistake. |
|
|
| |
| ▲ | wongarsu a day ago | parent | prev | next [-] | | Source? Has Anthropic's annualized revenue not quadrupled in the last 7 months? And OpenAI's annualized revenue quadrupled since January 2025? Which is only unimpressive by comparison to Anthropic's meteoric revenue growth I'd be with you if you claimed that the revenue hasn't translated into substantial profits. Being able to spend a lot of money to get less money back is not that impressive. But revenue by itself is on a dramatic rise as capabilities improve | | |
| ▲ | InsideOutSanta 10 minutes ago | parent [-] | | > Anthropic's annualized revenue That's not a meaningful number, and even if it were, quadrupled isn't nearly enough. |
| |
| ▲ | paxys a day ago | parent | prev | next [-] | | Moreover there’s no guarantee that eventual AI profits (if any) will go to the companies investing all this cash. If the worst case scenario of Chinese labs building and serving frontier-level models on 2nd tier nvidia hardware comes to be then what will be left of all the “hyperscalers”? | |
| ▲ | raincole a day ago | parent | prev | next [-] | | Except it did get translated to a dramatic increase in revenue. "Dramatic increase" is a ridiculous understatement here, by the way. | |
| ▲ | budsniffer952 a day ago | parent | prev [-] | | >not translating to a dramatic increase in revenue. Completely false. AI and AI related revenues are growing exponentially. | | |
| ▲ | TheOtherHobbes a day ago | parent | next [-] | | Expenditure on compute is growing even more exponentially. | |
| ▲ | InsideOutSanta a day ago | parent | prev | next [-] | | Exponential growth when you're starting from zero is neither difficult nor sufficient in this case. The title of the linked thread is "Dramatic cash burn." So clearly, the revenue did not grow anywhere fast enough. | |
| ▲ | dgellow a day ago | parent | prev | next [-] | | Not for the companies using the LLMs… | | |
| ▲ | budsniffer952 a day ago | parent [-] | | Are you denying that AI revenues are growing? Or are you just adding nonsense about "yeah but yeah but no value"? | | |
| ▲ | dgellow a day ago | parent [-] | | I’m saying there is no proof that companies _paying for AI_ are seeing a positive effect to their ROI. If you have such a proof, please share, that would be a massive news |
|
| |
| ▲ | weakfish a day ago | parent | prev | next [-] | | ...source? Please try and provide one for such strong claims. | |
| ▲ | jerf a day ago | parent | prev [-] | | I know it's easy to forget, and InsideOutSanta kind of anchored the conversation on "revenue", but profit is ultimately what matters. Back when Silicon Valley was merely insane rather than bat-guano crazy insane, it was commonly observed that it's not hard to build a business around selling a dollar for 95 cents. The point being that it doesn't necessarily mean much when you have a business doing that, because of course the demand will be insane. It doesn't mean you have a viable business. You don't know you have a viable business until you transition to selling a dollar for $1.03. Many a VC-funded business that looked successful, even wildly successful, has run aground on that transition, or at least, suddenly stopped looking so wildly successful. If AI-related expenses are also growing exponentially, and they are growing exponentially faster, it doesn't matter that revenue is growing exponentially. The AI funding has also now absolutely baked in exponential growth of expenses, because that's how debt works. A slow exponential, hopefully, but an exponential none-the-less. Something Hacker News needs to be periodically reminded of is that we are the field getting the most out of AI, and it's not even close. That's great for us. But the stocks aren't priced for "a pretty nice coding tool". They're priced for every field in the world getting even more value out of this than our field is getting now. That is, frankly, not happening anywhere near fast enough for the spending and stock valuations. When you don't have all the engineering guardrails that are present in software engineering [1], suddenly the AI is, ahem, exponentially less useful. As I say in that post, watch your AI actually doing something, even the frontier models. Watch the thinking traces. Watch how many times they bang into a guardrail of some sort; a failing test, a failing compile, a linter failure, a bash script that doesn't work, all those things. How much value would you get out of an AI coding assistant if the first time it banged into a guard rail it was done and you had to stop using it for that task? How much value would you get out of an AI coding assistant if instead it silently failed and just proceeded forward with errors that you lack the infrastructure to easily detect? In the first case, it would be fairly modest, almost certainly not worth the money, and in the second, it would be worth paying to not use. Even in our field, while the rate of code output has increased substantially, the rate of value generation increase has been quite a bit more modest. I have observed, and heard from a number of other places, that while my own output has increased somewhat we still generally can't plan on being able to work with other teams at much faster a rate than we used to. There's a viable business here but I can't see how all these companies expect to be returning all this revenue in any financially sensible period of time. They're all spending like if only they spend enough they can own about %900 of the market in three years. They can't all do that, even accounting for "AI makes the market bigger". And they're wildly vulnerable to some new solution coming out that obsoletes all this spending, like an ASIC that starts running a popular model directly (especially if model capabilities plateau), meaning that all this nVidia GPU spending is so much dead silicon. Or someone comes out with a much more efficient way to train models. There has to be some insight we're missing; humans do not learn what they do by having the entire contents of the Internet poured through their head hundreds of times over. We are far more efficient with our training data. What if someone works out a solution to that and we don't need to spend billions on GPUs but only millions? The whole spending proposition could collapse overnight and the companies that suddenly have three orders of magnitude too much hardware and the debt to match would be up a creek without a paddle. [1]: https://jerf.org/iri/post/2026/programming_is_engineering/ | | |
| ▲ | 650 a day ago | parent | next [-] | | I very much agree with this. Even the top tier models today, without the unit tests, without integration tests, and domain experts reviewing the code would flounder for 50% of the work they do. Sure they can write the unit tests and integration tests themselves, but at that point you aren't in need of a specific system being built, but rather an out of the box solution would probably fit your needs. It does speed up the grunt boilerplate work of development quite a bit, it does help with gnarly bugs and the like, but expertise is still needed. And we as engineers/programmers have systems in place that make using AI easier, we have the human context windows to be able to parse the technical jargon the AI spits out. Will AI for the masses be akin to slightly better automation? | |
| ▲ | sodapopcan a day ago | parent | prev [-] | | > we are the field getting the most out of AI, and it's not even close. Just emphasizing that as, due to spending far too much time online the past week, I've been seeing a fair bit of this. "AI is definitely gaining popularity because all the software companies I know are going all in on it." |
|
|
| |
| ▲ | grey-area a day ago | parent | prev | next [-] | | For certain values of ‘dramatic improvement’. Is lots more important work being done with LLMs? Not much sign of it yet, they’ve been helpful for experts at times (e.g. vuln research or maths research) but that hardly justifies the vast sums for Google investors. | |
| ▲ | throwaway27448 a day ago | parent | prev | next [-] | | Presumably at some point you need a measurable productivity return yea? Maybe organizations are not built around skill and aptitude so much as liability, which LLMs cannot provide barring (very welcome and also very unlikely) legislation in the US. | | |
| ▲ | WarmWash a day ago | parent | next [-] | | The infamous 2025 MIT study that found almost all AI pilots in companies were failing, also found that virtually every worker was using AI many times a week if not daily. Turns out people just use their personal AI accounts rather than company ones. Which would make sense if you want to claim the work the AI does as your own. | | |
| ▲ | gowld a day ago | parent [-] | | AI was garbage quality or OK but unimportant (Grammarly-esque) in early 2025. A new study is needed. |
| |
| ▲ | budsniffer952 a day ago | parent | prev [-] | | >Presumably at some point you need a measurable productivity return yea? At what point? This technology is brand new. Did you think we were going to double productivity in 3 years? Capacity is being built. It's hard to build data centres, there are no chips, there is no memory, it's hard to get talent, we don't have the energy to power the facilities. No one knows where this is going. We are scratching the surface. There is an absolute boom happening, and yet every day I have log onto Hacker News and read this nonsense about everything falling apart. Are we living in the same universe??? So-called "technologists" saying, "meh, it's not that cool". Okay. Guess what? You're not Michael Burry. Nobody cares or will care that you "called it". Look around this place: you aren't even slightly contrarian. | | |
| ▲ | TheOtherHobbes a day ago | parent [-] | | "We would be profitable if we had the resources but we don't," isn't the smackdown argument you seem to believe it is. There used to be a thing where successful tech companies were profitable right out of the gate, and very successful companies doubled those profits for years, and companies who bought and used the tech could point to clear, actioned, benefits and cost savings. Now it's all "This will be really, really profitable one day, probably, if the omens align and we can deal with all of the problems." |
|
| |
| ▲ | ForHackernews a day ago | parent | prev | next [-] | | No, because the LLMs will keep getting more efficient and capable. Distillation and quantization will mean firms spending trillions on giant data centres are left holding the bag. I suspect Apple ends up laughing all the way to the bank. https://github.com/microsoft/BitNet | | |
| ▲ | InsideOutSanta a day ago | parent | next [-] | | Everyone who initially failed at this stumbled backward into victory. | |
| ▲ | skybrian a day ago | parent | prev [-] | | I suppose there is some limit, but it’s a bit hard to believe that Google won’t find a good use for more data centers. |
| |
| ▲ | epolanski a day ago | parent | prev | next [-] | | It's an internet/railroad issue again. Tech is real, impact is gigantic, long term winners hard to predict, capex spending hard to recoup soon, if ever. And differently than internet or rails, you don't build once and maintain later, but enter a loop of ever increased spending to keep on top of the arms race and ever exploding usage. | |
| ▲ | finnthehuman a day ago | parent | prev | next [-] | | > not sure how to square this with the dramatic improvement in LLM capabilities A good tech demo doesn’t matter to the business if the products don’t become profitable at the scale the investment chased. | |
| ▲ | vrganj a day ago | parent | prev [-] | | I'm not sure I've seen what I would call dramatic improvement since maybe GPT4? Sure, things got better. But I'd call it iterative more than revolutionary. I still wouldn't trust any of the models to do anything meaningful unattended. They all still do dumb shit all the time. Plus, even if they were genuinely dramatically better, the businesses sure as hell aren't. They're burning money left and right, they have no moat, Chinese open models are basically equivalent these days. What's the path to profitability, or hell, break-even? How do you envision this being anything but a giant money pit? | | |
| ▲ | Aurornis a day ago | parent | next [-] | | > I'm not sure I've seen what I would call dramatic improvement since maybe GPT4? LLM conversations online are so weird. Whenever I read things like this it’s like I’m living in a different world than the other person. GPT4 was almost useless compared to what we have available today. | | |
| ▲ | hedora a day ago | parent [-] | | I mostly use anthropic models, but there was a big step function when claude code came out, and it’s been incremental or a plateau since then. Opus 4.6 and 4.8 are basically indistinguishable from Fable and Sonnet 5. 4.7 was a hot mess. The guardrails on 4.8 and 5.0 make them worse than 4.6 for many tasks. So, even if Fable is theoretically better, refusals/downgrades make it a worse product in practice. Who cares if it outperforms on 1-2% of real world tasks if 5-10% of tasks are blocked? I’d bet most people could be downgraded to a 12 month old frontier model, and not notice for a week or so. Anthropic’s big problem is that open weight models are 0-6 months behind. So, their product is commoditized and margins are never going to be good. | | |
| ▲ | Aurornis a day ago | parent [-] | | > I’d bet most people could be downgraded to a 12 month old frontier model, and not notice for a week or so. This is another unbelievable claim. I actually used frontier models from 12 months ago and they were completely different. |
|
| |
| ▲ | malfist a day ago | parent | prev | next [-] | | It sure is funny how everyone claims the current model is a "dramatic improvement" over the models from X months ago. You'd think if there had been that many dramatic improvements I'd have to babysit an LLM less frequently. | |
| ▲ | budsniffer952 a day ago | parent | prev [-] | | [flagged] | | |
| ▲ | dgellow a day ago | parent | next [-] | | It doesn’t matter… are those companies using AI getting a positive ROI? So far there is no signs it is the case, unless you’re yourself selling AI stuff | | |
| ▲ | budsniffer952 a day ago | parent [-] | | >are those companies using AI getting a positive ROI? Yes. >So far there is no signs it is the case How could you possibly know this? | | |
| ▲ | TheOtherHobbes a day ago | parent | next [-] | | Because there are almost no "We used AI to save money, improve our services, and gain more customers" success stories. There's a lot of "We fired a lot of people because we're sheep and now we're having to hire some of them back" stories. And a lot of "A few engineers are doing a lot more, but we're not quite sure how to turn that into actual money" stories. And even more "We told everyone to tokenmaxx, and they did, and then we realised it was costing too much, so we stopped," stories. But there really hasn't been a deluge of "AI has cut costs and increased profits while also improving quality" stories. There has been a small outbreak of vibe-startups offering fairly generic services - mostly marketing and adjacent - who are doing okay, possibly. But established tech? Doubt. | |
| ▲ | weakfish a day ago | parent | prev [-] | | How could you? Can _someone_ in this thread _please_ provide a source? |
|
| |
| ▲ | mcphage a day ago | parent | prev | next [-] | | They are! Coincidentally, there's been a precipitous decline in software quality and reliability the last few years. | | |
| ▲ | TeMPOraL a day ago | parent [-] | | No, there wasn't. The step decline started when SaaS was embraced, and everything turned into webshit. |
| |
| ▲ | vrganj a day ago | parent | prev [-] | | Sure, and my nephew is building nice little trucks with Legos. The point is, is anyone getting any value from it? | | |
| ▲ | budsniffer952 a day ago | parent [-] | | >The point is, is anyone getting any value from it? No, you're right, no one is getting any value from it. | | |
| ▲ | flextheruler a day ago | parent [-] | | Sarcasm over a legitimate question really? After about 4 years I think it's totally acceptable to ask where the profit is on any company's 10-K. Where are even the revenues on a 10-K? |
|
|
|
|
|