| ▲ | consumer451 3 hours ago | |||||||
This is a fun thought experiment. I believe that we are now at the $5 Uber (2014) phase of LLMs. Where will it go from here? How much will a synthetic mid-level dev (Opus 4.5) cost in 2028, after the VC subsidies are gone? I would imagine as much as possible? Dynamic pricing? Will the SOTA model labs even sell API keys to anyone other than partners/whales? Why even that? They are the personalized app devs and hosts! Man, this is the golden age of building. Not everyone can do it yet, and every project you can imagine is greatly subsidized. How long will that last? | ||||||||
| ▲ | tern 3 hours ago | parent | next [-] | |||||||
While I remember $5 Ubers fondly, I think this situation is significantly more complex: - Models will get cheaper, maybe way cheaper - Model harnesses will get more complex, maybe way more complex - Local models may become competitive - Capital-backed access to more tokens may become absurdly advantaged, or not The only thing I think you can count on is that more money buys more tokens, so the more money you have, the more power you will have ... as always. But whether some version of the current subsidy, which levels the playing field, will persist seems really hard to model. All I can say is, the bad scenarios I can imagine are pretty bad indeed—much worse than that it's now cheaper for me to own a car, while it wasn't 10 years ago. | ||||||||
| ▲ | FuckButtons an hour ago | parent | prev | next [-] | |||||||
I can run Minimax-m2.1 on my m4 MacBook Pro at ~26 tokens/second. It’s not opus, but it can definitely do useful work when kept on a tight leash. If models improve at anything like the rate we have seen over the last 2 years I would imagine something as good as opus 4.5 will run on similarly specced new hardware by then. | ||||||||
| ||||||||
| ▲ | andai 3 hours ago | parent | prev [-] | |||||||
The real question is how long it'll take for Z.ai to clone it at 80% quality and offer it at cost. The answer appears to be "like 3 months". | ||||||||
| ||||||||