| ▲ | aurareturn an hour ago | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
It isn't a commodity product in my opinion. Far from it. I think it will ultimately be a monopoly or duopoly for SOTA. The mid to low end is commodity, yes. But SOTA models are not commodities. The number of competitors for SOTA drops by a few every year. The winners make more money, get more revenue, buy more compute, train better model with compute, buy best talent, and the cycle goes. I think it's easier to fall behind and never catch back up than people think. One disastrous training run can leave a lab months to a year behind. For example, Meta's disastrous LLAMA 4 models. Meta is lucky to have their ads business as a funding source. However, Anthropic's revenue is growing so fast, that ability to use ads as a funding source to stay in the race may not last much longer for Meta. To me, SOTA LLM training is very much like new chip fab nodes. One disastrous node can put you behind for many years or forever. The cost to build the next chip node doubles every every 4 years (Rock's law). The cost to train the next SOTA model likely has some similar power law which means over time, it's too costly for losers to keep up. The only reason TSMC isn't a defacto monopoly for advanced chip nodes is strictly due to geopolitics. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | orwin an hour ago | parent | next [-] | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
But who needs SOTA models, really? It was necessary 10 months ago, but now? | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | 4fggfd an hour ago | parent | prev [-] | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Mate the vast majority of firms dont care about this SOTA crap. They can barely get any efficiency gains beyond the productivity of software engineers. And even that is not really translating into financial performance. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||