Remix.run Logo
Schnitz 5 hours ago

If distillation leads to a model that is much cheaper to run yet provides similar intelligence then why doesn’t Anthropic distill their own models?

ashu1461 5 hours ago | parent [-]

Don't they do it already ? Aren't smaller models distilled versions of bigger models