Remix.run Logo
sroussey 4 hours ago

Would love to see this implemented with @huggingface/kernels for shader compilation for Webgpu.

HenryNdubuaku 2 hours ago | parent [-]

noted, we'd look into this, thanks

sroussey 2 hours ago | parent [-]

For reference: https://huggingface.co/blog/webgpu-kernels

I think it will be the basis for a rewrite of transformers.js v5, but no need for you to wait as you would likely want direct access. It is also way better than loading WASM, and faster to boot!