| ▲ | syrrim a day ago | |
> 1. Any cloud business essentially is "unpacking servers and plugging them in." Yet the cloud business has been exploding quarter-over-quarter ever since AWS came online. To the tune of double-digit billions cash flow every quarter for each of the hyperscalers, even before the AI boom. No, major cloud providers are mainly a software business. They provide unique manage cloud offerings, which provides value add over raw hardware as well as lock in. People on AWS cannot just move to GCP, let alone DO. Hence amazon can charge a substantial premium over the price of the hardware, which is why they make so much money. If all you are doing is plugging in GPUs, you don't provide that value add and are going to have very slim profits. | ||
| ▲ | keeda 10 hours ago | parent [-] | |
1. Cloud providers significantly markup bare metal and VMs even without managed services (lookup the numbers.) Managed services are the lock-in Trojan Horse clouds love to push but not everyone falls for them. Customers are OK paying for the fat margins not because of the managed services, but because of the elasticity, convenience and reduction in SRE headcount. 2. Why can’t cloud providers do the same thing with GPUs that they do with other servers? Are GPUs somehow not amenable to managed cloud offerings wrapping them? 3. Literally just having any access to GPUs (or heck, even memory) itself is the value add today. Maybe when we have supply to match the demand things will change, but that seems to be a ways away and points 1 and 2 above will still be in play anyways. | ||