| ▲ | UncleOxidant 2 hours ago |
| Aren't there other ONNX runtimes out there? A quick google search shows a few written in Rust: Tract, RTen, WONNX, Burn&Candle. Also, IIRC there's a Julia-based one as well. |
|
| ▲ | antimora 2 hours ago | parent [-] |
| https://github.com/tracel-ai/burn-onnx I maintain this project at the moment. It convert ONNX models into native, backend-agnostic Burn code for inference and fine-tuning. |
| |
| ▲ | ytxm 2 hours ago | parent [-] | | Have used it with wasm and it's lovely, but I was kindof disappointed to learn internally it's basically another serialisation format. I imagined gigabytes of generated Rust code hehe | | |
| ▲ | antimora an hour ago | parent [-] | | The graph is converted into Rust code that calls Burn APIs but the weights are converted into Burn's format, called burnpack (similar to safetensors but instead of JSON we use CBOR for weights meta data). |
|
|