Technically, you could do that, but we trained this one from the ground up!
That sounds like an enormously expensive exercise.
At <50M parameters, training costs are completely trivial. You'll spend a lot more on your rent this month.