| ▲ | seamossfet 8 hours ago | |
We use the ONNX runtime for small models in the browser https://github.com/microsoft/onnxruntime | ||
| ▲ | sroussey 8 hours ago | parent | next [-] | |
And ONNX is what Transformers.js uses as well, at least for the moment. | ||
| ▲ | vatsachak 5 hours ago | parent | prev [-] | |
Yeah ONNX runtime or Burn-rs are great because they compile to wasm | ||