| ▲ | HarHarVeryFunny 2 days ago | |
Just guessing here, but these small models may well be essentially distillations of larger ones, with this being where their power comes from. e.g. Use a large model to generate synthetic reasoning traces, then train a small model on those. | ||