Since NVIDIA owns huggingface now and huggingface has the excellent Candle [1] crate for inference on Rust, this seems like a good step towards nice native Rust kernels.

[1] https://github.com/huggingface/candle

▲

jacobgorm 11 hours ago | parent [-]

Nobody cares if kernels are written in Rust. Kernels were meant to be written in C, but if you want to go more high-level try Triton or a similar DSL that nicely abstract tile sizes etc.

▲

keithnz 10 hours ago | parent | next [-]

kernels aren't meant to be written by any defined language. C is just a traditionally good default language that took over from assembly. No particular reason we have to stick with C.

	▲	chadcmulligan 9 hours ago \| parent [-]
		And quite a few reasons that something better than C should be used. Rust seems a good candidate.

▲

pjmlp 4 hours ago | parent | prev | next [-]

That is exactly why OpenCL failed adoption, focusing on C, instead of being polyglot like CUDA.

▲

zozbot234 4 hours ago | parent [-]

SYCL is the natively polyglot counterpart, with practical implementations of it compiling down to the same sort of SPIR-V kernels as OpenCL. (OTOH, much of the current adoption on the open standards side seems to target the more widely supported SPIR-V compute shaders, via Vulkan compute.)

	▲	pjmlp 3 hours ago \| parent [-]
		Not really, first of all it is for C++, not the range of languages supported by CUDA. Before SPIR was a thing in OpenCL, Khronos could not understand why anyone would care about anything else other than C99, or why supporting Fortran on GPUs was at all relevant. Secondly, from the competition only Intel cares about SYCL with their own sugar on top, OpenAPI. AMD hasn't cared one second about it. You may mention Codeplay, which is anyway an Intel owned company since 2022. As for Vulkan, it doesn't have neither the features, nor the tooling that CUDA enjoys, it is the usual putting up with using LEGOs from different brands, with various pin sizes, that is so common with Khronos.

▲

Anoian 2 hours ago | parent | prev | next [-]

I have never seen a comment this gray

▲

10 hours ago | parent | prev | next [-]

[deleted]

▲

cpill 10 hours ago | parent | prev [-]

oh no no no, this is going to break the CPP hold on AI and game dev.

	▲	pjmlp 4 hours ago \| parent [-]
		Nah, Rust compiler still needs C++ to be built in first place, and everyone on AI uses LLVM as infrastructure.