| ▲ | epihelix 3 hours ago | |
There are also prebuilt binary archives for just about any distribution and inference backend for the latest github release: https://github.com/ggml-org/llama.cpp/releases No need to compile unless you really need to. | ||
| ▲ | usagisushi 3 hours ago | parent [-] | |
This. I use mise's github backend `mise use --global --pin github:ggml-org/llama.cpp` to grab the release binaries for Linux, Windows and macOS. | ||