But nobody wants to distill Google's models, Gemini is really bad.

strong agreement, I've stopped using all closed weight models on principle, but the latest gemini models have increased hallucinations and now talk back, so double reason not to use them