The B200 was launched in 2024 if I'm not mistaken. The big gamble with this might be how fast these will deprecate in value/use as soon as Nvidia launches a new and better product.

At the moment at least Nvidia doesn't have a incentive to release a new product because it's sold out as it is and probably doesn't want to plunge their customers in depth with outdated products?

The gamble in this case is pocket change. They could comfortably spend this amount every year and just use precious years for overnight / batch processing jobs when they become less useful for dev work but remain operational.

In related news, Core 4 Solutions listed a decommissioned $60 million AI supercomputer cluster featuring 9,600 Nvidia A100 GPUs on eBay. It's six years old. Nvidia isn't Intel with tick and tock, but they're still going to come out with newer hardware every year.

They do want to launch new product - Vera Rubin