Remix.run Logo
▲ octoberfranklin 2 hours ago

FWIW that is about $331,000 on low-onboarding-grief clouds (e.g. vast.ai) right now using the SXM variants they used.

You might be able to shave that down using a different flavor of H200 (like PCIe) but it would take more hours, so benefits are unclear.

▲lumost an hour ago | parent [-]

Savings would likely be larger with alternative accelerators such as trainium, no?

▲octoberfranklin an hour ago | parent [-]

Savings would likely be larger with magic beans such as floobarbaz, no?

But seriously. If there were a cheaper and reliable way, I'm sure the authors would have mentioned it instead of H200 SXM modules. They're trying to brag about cheap training.

Maybe you wanted to use an opportunity to shill tranium.

▲phs318u 27 minutes ago | parent [-]

> Maybe you wanted to use an opportunity to shill tranium.

This was unnecessary and against HN guidelines to engage in good faith.