| ▲ | simonw 2 hours ago | |
Training costs are fixed. You spend $X-bn training a model and that single model then benefits all of your customers. Inference costs grow with your users. Provided you are making a profit on that inference you can eventually cover your training costs if you sign up enough paying customers. If you LOSE money on inference every new customer makes your financial position worse. | ||