I'm currently working on an open-source LLM inference engine [1] for browsers via webGPU. If anyone wants to try or has any suggestions, I'm happy to listen :)

1. https://github.com/stfurkan/bitgpu

Demo: https://stfurkan.github.io/bitgpu/examples/chat.html

2. https://aidekin.com --> this is one of my project that's currently using bitgpu engine