| ▲ | octoberfranklin 2 hours ago | ||||||||||||||||
FWIW that is about $331,000 on low-onboarding-grief clouds (e.g. vast.ai) right now using the SXM variants they used. You might be able to shave that down using a different flavor of H200 (like PCIe) but it would take more hours, so benefits are unclear. | |||||||||||||||||
| ▲ | lumost an hour ago | parent [-] | ||||||||||||||||
Savings would likely be larger with alternative accelerators such as trainium, no? | |||||||||||||||||
| |||||||||||||||||