▲ | foobarian 5 days ago | |
> Scaling AI will require an exponential increase in compute and processing power, I think there is something more happening with AI scaling; I think the scaling factor per user is a lot higher and a lot more expensive. Compare to the big initial internet companies. You added one server you could handle thousands more users; incremental cost was very low, not to mention the revenue captured through whatever adtech means. Not so with AI workloads; they are so much more expensive than ad revenue it's hard to break even even with an actual paid subscription. | ||
▲ | RugnirViking 5 days ago | parent [-] | |
I dont fully even get why; inference costs are way lower than training costs no? |