| ▲ | qwe----3 2 hours ago | |||||||
Have you trained models? If not then you can't really speak to how effective distillation is (answer: it is very effective) | ||||||||
| ▲ | randbyte 2 hours ago | parent [-] | |||||||
lol. Have you? What kind of distill you are talking about? It’s only effective in the surface, small scale model or output preference. Not useful for long reasoning chain. | ||||||||
| ||||||||