No. Distillation trains on a teach model's logits or output tokens.