| ▲ | ashvardanian 7 hours ago | |
One fairly revealing microbenchmark for WASM runtimes is `int8` dot products & angular/cosine distances. (My) NumKong [1] has implementations targeting both vanilla AVX2/Haswell and AVX2-VNNI/Alder Lake, which makes it easy to see where runtimes and code generators leave performance on the table. I started a few Wasmtime/Cranelift PRs around this, but didn’t manage to finish them :facepalm: Might be a fun weekend project for someone interested in backend/codegen work. | ||