I see, so you're off the opinion anthropic could provide a loras adaptation per user ready for use to enable timely response for every subscriber.

It is an interesting thought to explore. I admit I'm not a specialist whatsoever on the topic, from my perspective that sounds like an incredible challenging ops problem.... But again, I don't work for anthropic and maybe they're up to the challenge as you seem to think.

If users get a fixed set/numbers of Paramus for LoRa - say 1-5% - it doesn't sound that crazy.

The crazy part is probably loading, running a model pr users - but if the untrained (unspecialized?) model can somehow stay resident - might be possible to load adjusted weights on demand?

I suppose each run now needs a different context pr user/customer anyway, for cache hit rate, if nothing else?