| ▲ | surgical_fire 2 hours ago | |
It's impossible to tell at this point. I have no idea how much of their compute is also subsidized through deals they have with the hyperscalers, etc. It's irrelevant how big their models may or may not be. Depreciation needs to be taken into account, so does actual compute expenses. Training those models is not cheap, and you will never reach a point where a model is "final". You will always need to train the next one. Eventually the bill has to be paid. Money and resources are finite still. | ||
| ▲ | HDThoreaun 2 hours ago | parent [-] | |
Well the third party operators on open router are assuredly operating at a profit, including depreciation. The only reason they’d be profitable at 1/10 the price of the labs while the labs aren’t profitable is if inference costs the labs 10x as much per token | ||