| ▲ | dennis16384 2 hours ago | |
I had a similar success with Model2Vec static embedder and NER inference (both GGUF, compiled for WASM), ported to plain C from ONNX Runtime. Wasm size from 30Mb to 300kb and 1.5x speedup. It's definitely worth it for performance or distribution size. | ||