Would love to see this implemented with @huggingface/kernels for shader compilation for Webgpu.
noted, we'd look into this, thanks
For reference: https://huggingface.co/blog/webgpu-kernels
I think it will be the basis for a rewrite of transformers.js v5, but no need for you to wait as you would likely want direct access. It is also way better than loading WASM, and faster to boot!