| ▲ | ungreased0675 4 hours ago | ||||||||||||||||
Right now LLMs are heavily subsidized. When that ends, the actual cost of the service may exceed its usefulness for many use cases. | |||||||||||||||||
| ▲ | almostdeadguy 3 hours ago | parent [-] | ||||||||||||||||
I'm less sure of the fact that ending subsidized token consumption (in isolation) will happen and change this. I think we've seen this play out before with other tech companies where discounting early use ends up entrenching demand and allowing the company to build larger and more efficient infrastructure. I'm slightly _more_ convinced (still not all that strongly) that the rising cost of memory and chips, data center construction that gets outpaced by computing demand, increasing energy costs, and low switching costs for customers will force the model labs to make changes that increase the barrier to entry (either via higher pricing, more restrictive rate limiting, etc.). or force their customers into longer term commitments. | |||||||||||||||||
| |||||||||||||||||