Remix.run Logo
simonw 7 days ago

Have you seen a 0.8GB model file floating around yet? I couldn't find one earlier.

reactordev 7 days ago | parent [-]

I think this is the one but it’s 0.8GB VRAM not 0.8GB size.

https://huggingface.co/google/gemma-4-E2B-it-qat-mobile-ct

But they could be cooking up a smaller one because the model card lists the Q_4 quants as being bigger than the mobile or text-only so I think we’ll need to wait for the Q_2_Distilled_Mobile_Textformer version. Still, just amazing work.