| ▲ | fooker 11 hours ago |
| > It might become cheaper or it might not If it does not, this is going to be first technology in the history of mankind that has not become cheaper. (But anyway, it already costs half compared to last year) |
|
| ▲ | ctoth 10 hours ago | parent | next [-] |
| > But anyway, it already costs half compared to last year You could not have bought Claude Opus 4.5 at any price one year ago I'm quite certain. The things that were available cost half of what they did then, and there are new things available. These are both true. I'm agreeing with you, to be clear. There are two pieces I expect to continue: inference for existing models will continue to get cheaper. Models will continue to get better. Three things, actually. The "hitting a wall" / "plateau" people will continue to be loud and wrong. Just as they have been since 2018[0]. [0]: https://blog.irvingwb.com/blog/2018/09/a-critical-appraisal-... |
| |
| ▲ | simianwords 10 hours ago | parent | next [-] | | interesting post. i wonder if these people go back and introspect on how incorrect they have been? do they feel the need to address it? | | |
| ▲ | fooker 10 hours ago | parent | next [-] | | No, people do not do that. This is harmless when it comes to tech opinions but causes real damage in politics and activism. People get really attached to ideals and ideas, and keep sticking to those after they fail to work again and again. | | |
| ▲ | simianwords 10 hours ago | parent [-] | | i don't think it is harmless or we are incentivising people to just say whatever they want without any care for truth. people's reputations should be attached to their predictions. |
| |
| ▲ | cogogo 9 hours ago | parent | prev | next [-] | | Some people definitely do but how do they go and address it? A fresh example in that it addresses pure misinformation. I just screwed up and told some neighbors garbage collection was delayed for a day because of almost 2ft of snow. Turns out it was just food waste and I was distracted checking the app and read the notification poorly. I went back to tell them (do not know them at all just everyone is chattier digging out of a storm) and they were not there. Feel terrible and no real viable remedy. Hope they check themselves and realize I am an idiot. Even harder on the internet. | |
| ▲ | maest 5 hours ago | parent | prev [-] | | Do _you_ do that? | | |
| |
| ▲ | teaearlgraycold 3 hours ago | parent | prev | next [-] | | As a user of LLMs since GPT-3 there was noticeable stagnation in LLM utility after the release of GPT-4. But it seems the RLHF, tool calling, and UI have all come together in the last 12 months. I used to wonder what fools could be finding them so useful to claim a 10x multiplier - even as a user myself. These days I’m feeling more and more efficiency gains with Claude Code. | | |
| ▲ | HNisCIS 41 minutes ago | parent [-] | | That's the thing people are missing, the models plateaued a while ago, still making minor gains to this day, but not huge ones. The difference is now we've had time to figure out the tooling. I think there's still a ton of ground to cover there and maybe the models will improve given that the extra time, but I think it's foolish to consider people who predicted that completely wrong. There are also a lot of mathematical concerns that will cause problems in the near and distant future. Infinite progress is far from a given, we're already way behind where all the boosters thought we'd be my now. |
| |
| ▲ | bsder 8 hours ago | parent | prev [-] | | > The "hitting a wall" / "plateau" people will continue to be loud and wrong. Just as they have been since 2018[0]. Everybody who bet against Moore's Law was wrong ... until they weren't. And AI is the reaction to Moore's Law having broken. Nobody gave one iota of damn about trying to make programming easier until the chips couldn't double in speed anymore. | | |
| ▲ | twoodfin 8 hours ago | parent [-] | | This is exactly backwards: Dennard scaling stopped. Moore’s Law has continued and it’s what made training and running inference on these models practical at interactive timescales. | | |
| ▲ | bsder 7 hours ago | parent [-] | | You are technically correct. The best kind of correct. However, most people don't know the difference between the proper Moore's Law scaling (the cost of a transistor halves every 2 years) which is still continuing (sort of) and the colloquial version (the speed of a transistor doubles every 2 years) which got broken when Dennard scaling ran out. To them, Moore's Law just broke. Nevertheless, you are reinforcing my point. Nobody gave a damn about improving the "programming" side of things until the hardware side stopped speeding up. And rather than try to apply some human brainpower to fix the "programming" side, they threw a hideous number of those free (except for the electricity--but we don't mention that--LOL) transistors at the wall to create a broken, buggy, unpredictable machine simulacrum of a "programmer". (Side note: And to be fair, it looks like even the strong form of Moore's Law is finally slowing down, too) | | |
| ▲ | twoodfin 6 hours ago | parent [-] | | If you can turn a few dollars of electricity per hour into a junior-level programmer who never gets bored, tired, or needs breaks, that fundamentally changes the economics of information technology. And in fact, the agentic looped LLMs are executing much better than that today. They could stop advancing right now and still be revolutionary. |
|
|
|
|
|
| ▲ | peaseagee 10 hours ago | parent | prev | next [-] |
| That's not true. Many technologies get more expensive over time, as labor gets more expensive or as certain skills fall by the wayside, not everything is mass market. Have you tried getting a grandfather clock repaired lately? |
| |
| ▲ | willio58 10 hours ago | parent | next [-] | | Repairing grandfather clocks isn't more expensive now because it's gotten any harder; it's because the popularity of grandfather clocks is basically nonexistent compared to anything else to tell time. | |
| ▲ | simianwords 10 hours ago | parent | prev | next [-] | | "repairing a unique clock" getting costlier doesn't mean technology hasn't gotten cheaper. check out whether clocks have gotten cheaper in general. the answer is that it has. there is no economy of scale here in repairing a single clock. its not relevant to bring it up here. | | |
| ▲ | ipaddr 9 hours ago | parent [-] | | Clocks prices have gone up since 2020. Unless a cheaper better way to make clocks has emerged inflation causes prices to grow. | | |
| ▲ | fooker 9 hours ago | parent | next [-] | | Luxury watches have gone up, 'clocks' as a technology is cheaper than ever. You can buy one for 90 cents on temu. | | |
| ▲ | ipaddr 8 hours ago | parent [-] | | The landing cost for that 90 cent watch has gone way up. Shipping and to some degree taxes has pushed the price higher. | | |
| ▲ | pas 7 hours ago | parent [-] | | that's not the technology of course it's silly to talk about manufacturing methods and yield and cost efficiency without having an economy to embed all of this into, but ... technology got cheaper means that we have practical knowledge of how to make cheap clocks (given certain supply chains, given certain volume, and so and so) we can make very cheap very accurate clocks that can be embedded into whatever devices, but it requires the availability of fabs capable of doing MEMS components, supply materials, etc. |
|
| |
| ▲ | simianwords 9 hours ago | parent | prev [-] | | not true, clocks have gone down after accounting for inflation. verified using ChatGPT. | | |
| ▲ | ipaddr 8 hours ago | parent [-] | | You can't account for inflation because the price increase is inflation. | | |
| ▲ | pas 7 hours ago | parent | next [-] | | you can look at a basket of goods that doesn't have your specific product and compare directly but inflation is the general price level increase, this can be used as a deflator to get the price of whatever product in past/future money amount to see how the price of the product changed in "real" terms (ie. relative to the general price level change) | |
| ▲ | simianwords 8 hours ago | parent | prev [-] | | this is not true |
|
|
|
| |
| ▲ | esafak 10 hours ago | parent | prev | next [-] | | Instead of advancing tenuous examples you could suggest a realistic mechanism by which costs could rise, such as a Chinese advance on Taiwan, effecting TSMC, etc. | |
| ▲ | emtel 9 hours ago | parent | prev | next [-] | | Time-keeping is vastly cheaper. People don't want grandfather clocks. They want to tell time. And they can, more accurately, more easily, and much cheaper than their ancestors. | |
| ▲ | groby_b 10 hours ago | parent | prev | next [-] | | No. You don't get to make "technology gets more expensive over time" statements for deprecated technologies. Getting a bespoke flintstone axe is also pretty expensive, and has also absolutely no relevance to modern life. These discussions must, if they are to be useful, center in a population experience, not in unique personal moments. | | |
| ▲ | ipaddr 9 hours ago | parent | next [-] | | I purchased a 5T drive in 2019 and the price is higher now despite newer better drives going on the market since. Not much has down in price over the last few years. | | | |
| ▲ | solomonb 9 hours ago | parent | prev | next [-] | | okay how about the Francis Scott Key Bridge? https://marylandmatters.org/2025/11/17/key-bridge-replacemen... | | |
| ▲ | groby_b 7 hours ago | parent [-] | | You will get a different bridge. With very different technology. Same as "I can't repair my grandfather clock cheaply". In general, there are several things that are true for bridges that aren't true for most technology: * Technology has massively improved, but most people are not realizing that. (E.g. the Bay Bridge cost significantly more than the previous version, but that's because we'd like to not fall down again in the next earthquake)
* We still have little idea how to reason about the cost of bridges in general. (Seriously. It's an active research topic)
* It's a tiny market, with the major vendors forming an oligopoly
* It's infrastructure, not a standard good
* The buy side is almost exclusively governments. All of these mean expensive goods that are completely non-repeatable. You can't build the same bridge again. And on top of that, in a distorted market. But sure, the cost of "one bridge, please" has gone up over time. | | |
| ▲ | solomonb 6 hours ago | parent | next [-] | | This seems largely the same as any other technology. The prices of new technologies go down initially as we scale up and optimize it's production, but as soon as demand fades, due to newer technology or whatever, the cost of that technology goes up again. | |
| ▲ | fooker 7 hours ago | parent | prev [-] | | > But sure, the cost of "one bridge, please" has gone up over time. Even if you adjust for inflation? |
|
| |
| ▲ | arthurbrown 9 hours ago | parent | prev [-] | | Bought any RAM lately? Phone? GPU in the last decade? | | |
| ▲ | ipaddr 9 hours ago | parent [-] | | The latest iphone has gone down in price? It's double. I guess the marketing is working. | | |
| ▲ | xnyan 7 hours ago | parent [-] | | "Pens are not cheaper, look at this Montblanc" is not a good faith response. '84 Motorola DynaTAC - ~$12k AfI (adjusted for inflation) '89 MicroTAC ~$8k AfI '96 StarTAC ~$2k AfI `07 iPhone ~$673 AfI The current average smartphone sells for around $280. Phones are getting cheaper. |
|
|
| |
| ▲ | epidemiology 6 hours ago | parent | prev [-] | | Or riding in an uber? |
|
|
| ▲ | fulafel 2 hours ago | parent | prev | next [-] |
| I don't think computation is going to become more expensive, but there are techs that have become so: Nuclear power plants. Mobile phones. Oil extraction. (Oil rampdown is a survival imperative due to the climate catastrophe so there it's a very positive thing of course, though not sufficient...) |
|
| ▲ | InsideOutSanta 10 hours ago | parent | prev | next [-] |
| Sure, running an LLM is cheaper, but the way we use LLMs now requires way more tokens than last year. |
| |
| ▲ | fooker 10 hours ago | parent | next [-] | | 10x more tokens today cost less than than half of X tokens from ~mid 2024. | |
| ▲ | simianwords 10 hours ago | parent | prev [-] | | ok but the capabilities are also rising. what point are you trying to make? | | |
| ▲ | oytis 10 hours ago | parent [-] | | That it's not getting cheaper? | | |
| ▲ | jstummbillig 10 hours ago | parent | next [-] | | But it is, capability adjusted, which is the only way it makes sense. You can definitely produce last years capability at a huge discount. | |
| ▲ | simianwords 10 hours ago | parent | prev [-] | | you are wrong. https://epoch.ai/data-insights/llm-inference-price-trends this is accounting for the fact that more tokens are used. | | |
| ▲ | techpression 10 hours ago | parent [-] | | The chart shows that they’re right though. Newer models cost more than older models.
Sure they’re better but that’s moot if older models are not available or can’t solve the problem they’re tasked with. | | |
| ▲ | simianwords 9 hours ago | parent | next [-] | | this is incorrect. the cost to achieve the same task by old models is way higher than by new models. > Newer models cost more than older models where did you see this? | | |
| ▲ | techpression 9 hours ago | parent [-] | | On the link you shared, 4o vs 3.5 turbo price per 1m tokens. There’s no such thing as ”same task by old model”, you might get comparable results or you might not (and this is why the comparison fail, it’s not a comparison), the reason you pick the newer models is to increase chances of getting a good result. | | |
| ▲ | simianwords 9 hours ago | parent [-] | | > The dataset for this insight combines data on large language model (LLM) API prices and benchmark scores from Artificial Analysis and Epoch AI. We used this dataset to identify the lowest-priced LLMs that match or exceed a given score on a benchmark. We then fit a log-linear regression model to the prices of these LLMs over time, to measure the rate of decrease in price. We applied the same method to several benchmarks (e.g. MMLU, HumanEval) and performance thresholds (e.g. GPT-3.5 level, GPT-4o level) to determine the variation across performance metrics This should answer. In your case, GPT-3.5 definitely is cheaper per token than 4o but much much less capable. So they used a model that is cheaper than GPT-3.5 that achieved better performance for the analysis. |
|
| |
| ▲ | fooker 9 hours ago | parent | prev [-] | | OpenAI has always priced newer models lower than older ones. | | |
|
|
|
|
|
|
| ▲ | root_axis 8 hours ago | parent | prev | next [-] |
| Not true. Bitcoin has continued to rise in cost since its introduction (as in the aggregate cost incurred to run the network). LLMs will face their own challenges with respect to reducing costs, since self-attention grows quadratically. These are still early days, so there remains a lot of low hanging fruit in terms of optimizations, but all of that becomes negligible in the face of quadratic attention. |
| |
|
| ▲ | krupan 8 hours ago | parent | prev | next [-] |
| There are plenty of technologies that have not become cheaper, or at least not cheap enough, to go big and change the world. You probably haven't heard of them because obviously they didn't succeed. |
|
| ▲ | asadotzler 8 hours ago | parent | prev | next [-] |
| cheaper doesnt mean cheap enough to be viable after the bills come due |
|
| ▲ | ak_111 9 hours ago | parent | prev | next [-] |
| Concorde? |
|
| ▲ | runarberg 2 hours ago | parent | prev [-] |
| Supersonic jet engines, rockets to the moon, nuclear power plants, etc. etc. all have become more expensive. Superconductors were discovered in 1911, and we have been making them for as long as we have been making transistors in the 1950s, yet superconductors show no sign of becoming cheaper any time soon. There have been plenty of technologies in history which do not in fact become cheaper. LLMs are very likely to become such, as I suspect their usefulness will be superseded by cheaper (much cheaper in fact) specialized models. |
