That's what I mean by continual learning, skills, memory are a crutch until real learning can happen, which could be weights changing in the local instance.

And my point is that weight changes are not likely to have the economic ROI for their justification on a person-by-person basis

What you are suggesting is a very expensive late-training phase activity. It's also not clear anymore when fine-tuning helps or hurts. Progress is rapid