It’d be nice if there was a standard like ~/.local/llm/hugging-face-name.gguf or something.

Python heaviness is a more fundamental problem.