That's an important aspect of this that should really be part of the discussion on GitHub. But I've been told I'm not qualified to interject so I am not going to bother.

I will use WebLLM if I want something like this (with local AI guaranteed).