There are too many LLM-related projects. Setting up multiple runtimes, Python, Node, Go, Rust and then some environments, different CUDA versions, dependencies is tedious. Managing updates later is even worse.

So, I'm building a toolkit that allows to keep things simple for the end user. Run Ollama and Open WebUI configured to work together: `harbor up ollama webui`. Don't like Ollama? Then `harbor up llamacpp webui`. There are 17 backends, 14 frontends and 50+ different satellite projects, config profiles that can be imported from a URL, tunnels, and a helper desktop app.

https://github.com/av/harbor?tab=readme-ov-file#what-can-har...