| ▲ | SparkyMcUnicorn 4 days ago | |||||||||||||
Yes. MLC's inference engine runs on WebGPU/WASM. https://github.com/mlc-ai/web-llm-chat | ||||||||||||||
| ▲ | mg 4 days ago | parent [-] | |||||||||||||
Yeah, something like that, but without the WebGPU requirement. Neither FireFox nor Chromium support WebGPU on Linux. Maybe behind flags. But before using a technology, I would wait until it is available in the default config. Lets see when browsers will bring WebGPU to Linux. | ||||||||||||||
| ||||||||||||||