Remix.run Logo
kllrnohj 3 hours ago

Doesn't it come with Nvidia's blend of Ubuntu with a custom kernel? Do other distros work as well as "DGX OS" or are nvidia's kernel changes pretty important to have?

zipy124 2 hours ago | parent | next [-]

Hopefully better than support on their Jetson or orin boards, where compiling anything is hard because of the outdated stack.

cmrdporcupine 2 hours ago | parent | prev [-]

I've not noticed much in it that is NVIDIA specific.

But I would say that as an Ubuntu and Debian user for decades I have no incentive to use anything else on it and I'm just pleased to have a Linux on Aarch64 machine that is well supported for a change.

rnxrx 2 hours ago | parent | next [-]

For some value of "well supported" - NVIDIA's own internal catalogs (libraries, NIMs, etc) are still spotty on aarch64 coverage.

verdverm 2 hours ago | parent | prev [-]

afaict, they have their own package repo mirrors and a few dedicated packages for nvidia stuff

tbh, I was rather unimpressed with the out-of-box experience for an "ai" computer, you couldn't even run a model locally with the common tools people use (no llama-cpp, ollama, vllm, etc). No huggingface CLI eiher, like come on!

I did put together my eventual setup in a repo https://github.com/verdverm/sparky

I need to update that because I have a nice vllm setup on there now with 4 models running, but should be able to get anyone else going without having to muddle about as I did.