| ▲ | zkmon 5 hours ago | |
I'm waiting for FP8 quant, preferably from Google. | ||
| ▲ | mdp2021 26 minutes ago | parent [-] | |
If you accept the "ggml-org": https://huggingface.co/ggml-org/gemma-4-12B-it-GGUF/tree/mai... https://huggingface.co/ggml-org/gemma-4-12B-it-GGUF/blob/mai... | ||