| ▲ | mdp2021 9 days ago | |
If you accept the "ggml-org": https://huggingface.co/ggml-org/gemma-4-12B-it-GGUF/tree/mai... https://huggingface.co/ggml-org/gemma-4-12B-it-GGUF/blob/mai... | ||
| ▲ | zkmon 9 days ago | parent [-] | |
Do they run well on vLLM? | ||
| ▲ | mdp2021 9 days ago | |
If you accept the "ggml-org": https://huggingface.co/ggml-org/gemma-4-12B-it-GGUF/tree/mai... https://huggingface.co/ggml-org/gemma-4-12B-it-GGUF/blob/mai... | ||
| ▲ | zkmon 9 days ago | parent [-] | |
Do they run well on vLLM? | ||