As a user of local models, does this mean that there are 'magic incantations' that can increase the performance of some local models?

I see some details about recovering information via whatever technique. It's interesting, but appears not generalized.

So for a specific question, yes, but this is not about techniques like adding a good embedding that just generally tends to improve open model performance on certain tasks.

I don't think that follows from the published results. Would have been an interesting hypothesis to add though, and quite easy. Just throw the same setup at some benchmarks.