Remix.run Logo
cmrdporcupine 3 hours ago

But the point of such a machine generally is to have the equivalent of a GB300 NVL72 tray on your desk. It's so that you can do the work that belongs in a production DC eventually. Or at least that's now NVIDIA would like you to use it.

You could build out a complicated multi GPU setup of your own, but the work you do on inference tuning for your kernels etc would not necessarily translate to the real world.

But yes, if you just want to run GLM 5.3 on your own machine, that's a whole other story.