You might be interested in https://burn.dev, a Rust machine learning framework. It has CUDA and ROCm backends among others.

I’ve just tried the MNIST demo on that page, but at least in a third of cases it’s plainly misclassified with zero probability.

Is it due to WASM? Browser limitations? Does it impose any constraints on inference?

I am interested, thanks for sharing!