| ▲ | davyAdewoyin 3 hours ago | |||||||
How is China further behind if distillation cannot stop? I think it's a reasonable strategy to follow, even if they could train from scratch. | ||||||||
| ▲ | undeveloper 3 hours ago | parent [-] | |||||||
distillation results in a worse product than the actual teacher model iirc | ||||||||
| ||||||||