| ▲ | cmrdporcupine 2 hours ago | |
I've not noticed much in it that is NVIDIA specific. But I would say that as an Ubuntu and Debian user for decades I have no incentive to use anything else on it and I'm just pleased to have a Linux on Aarch64 machine that is well supported for a change. | ||
| ▲ | rnxrx 2 hours ago | parent | next [-] | |
For some value of "well supported" - NVIDIA's own internal catalogs (libraries, NIMs, etc) are still spotty on aarch64 coverage. | ||
| ▲ | verdverm 2 hours ago | parent | prev [-] | |
afaict, they have their own package repo mirrors and a few dedicated packages for nvidia stuff tbh, I was rather unimpressed with the out-of-box experience for an "ai" computer, you couldn't even run a model locally with the common tools people use (no llama-cpp, ollama, vllm, etc). No huggingface CLI eiher, like come on! I did put together my eventual setup in a repo https://github.com/verdverm/sparky I need to update that because I have a nice vllm setup on there now with 4 models running, but should be able to get anyone else going without having to muddle about as I did. | ||