on the linked GitHub page they list support Diffusers, ComfyUI, vLLM-Omni, SGLang, and LightX2V with links to each

mdp2021 8 hours ago | parent [-]

> Diffusers, ComfyUI, vLLM-Omni, SGLang, and LightX2V

I think that's all Python (not a direct executable).

You could just do (see the "Quick Start") four `pip install` and have a dozen lines script to generate the image. But `llama.cpp` and similar do not require e.g. installing Torch (or PyTorch) - you can use `llama.cpp` on a non-specialized machine.

▲

wgd 7 hours ago | parent [-]

"just"

I don't think I have ever once run "pip install transformers" and had it work without three rounds of fiddling

▲

mdp2021 2 hours ago | parent [-]

Or trying to install the whole of CUDA on machines that do not even have a GPU (not Nvidia, not anything past the embedded)...

Yep, that's (also) what I meant ;)

Lean, efficient... Also sensible and trouble-less.

	▲	iugtmkbdfil834 an hour ago \| parent [-]
		The 'not nvidia' is no longer a deal breaker by itself.