| ▲ | mrweasel 3 hours ago | |||||||||||||||||||||||||||||||||||||||||||||||||||||||
I can't read the original Chinese text, but if it's revenue, then you still can't say anything about profitability. Housing and powering one GPU should be way less than $38 per hour, so there should be a profit on inference. If that profit can cover training new models we don't know, but it would appear to not be the case. For the past year or two I think it has generally been agreed that inference is profitable, but the LLM business as a whole is not. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | v9v 2 hours ago | parent | next [-] | |||||||||||||||||||||||||||||||||||||||||||||||||||||||
I seem to recall the leaked Liang Wenfeng speech gave a figure of 8-12(?) months of inference recouping the training costs of the model. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | laylower 33 minutes ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||||||||||||||||||||
What about sourcing the asset itself? It's like a factory is it not? You pay for the asset (tenancy in a data center) and then you pay for housing, powering, cooling, etc. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | sylware 2 hours ago | parent | prev [-] | |||||||||||||||||||||||||||||||||||||||||||||||||||||||
Unless the money of the investors is going somewhere else... | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||