| ▲ | Wowfunhappy 2 days ago | ||||||||||||||||
Hi! Do you ever make quants of the base models? I'm interested in experimenting with them in non-chat contexts. | |||||||||||||||||
| ▲ | car a day ago | parent [-] | ||||||||||||||||
Yes, they are listed on huggingface. The instruction trained models have an 'it' in their name. https://huggingface.co/collections/unsloth/gemma-4 Edit: Sorry, I'm not sure if this is a quant, but it says 'finetuned' from the Google Gemma 4 parent snapshot. It's the same size as the UD 8-bit quant though. | |||||||||||||||||
| |||||||||||||||||