I think what you want is this: https://github.com/mlc-ai/web-llm