| ▲ | the__alchemist 14 days ago |
| Rust support next? RN I am manually [de]serializing my data structures as byte arrays to/from the kernels. It would be nice to have truly shared data structures like CUDA gives you in C++! |
|
| ▲ | KeplerBoy 14 days ago | parent | next [-] |
| Isn't Rust still very seldomly used in the areas where CUDA shines (e.g. number crunching of any kind, let it be simulations or linear algebra)? Imo C++ or even Fortran are perfectly fine choices for those things, since the memory allocation pattern aren't that complicated. |
| |
| ▲ | IshKebab 14 days ago | parent | next [-] | | Mainly because number crunching code tends to be very long-lived (hence why FORTRAN is still in use). | | |
| ▲ | nine_k 14 days ago | parent [-] | | Not only that. Fortran is very good for writing number-crunching code. Modern Fortran is a pretty ergonomic language, it gives you a really easy way to auto-parallelize things in many ways, and new Fortran code is being produce unironically. Of course it normally uses the treasure trove of existing numerical Fortran code. (Source: a friend who worked at CERN.) |
| |
| ▲ | pjmlp 14 days ago | parent | prev [-] | | Yes, and the new kid in town, slang has more chances of adoption. | | |
| ▲ | KeplerBoy 14 days ago | parent [-] | | sorry, could you link to the project? Seems there are quite a few languages called slang. | | |
|
|
|
| ▲ | chasely 14 days ago | parent | prev | next [-] |
| The Rust-CUDA project just recently started up again [0], I've started digging into it a little bit and am hoping to contribute to it since the summers are a little slower for me. [0] https://github.com/rust-gpu/rust-cuda |
| |
| ▲ | the__alchemist 14 days ago | parent [-] | | Still broken though! Has been for years. In a recent GH issue regarding desires for the reboot, I asked: "Try it on a few different machines (OS, GPUs, CUDA versions etc), make it work on modern RustC and CUDA versions without errors." The response was "That will be quite some work." Meanwhile, Cudarc works... | | |
|
|
| ▲ | LegNeato 14 days ago | parent | prev | next [-] |
| https://github.com/rust-gpu/rust-cuda |
| |
|
| ▲ | Micoloth 14 days ago | parent | prev | next [-] |
| What do you think of the Burn framework? (Honest question, I have no clue what I’m talking about) |
| |
| ▲ | airstrike 14 days ago | parent | next [-] | | I used it to train my own mini-GPT and I liked it quite a bit. I tend to favor a different style of Rust with fewer generics but maybe that just can't be avoided given the goals of that project. The crate seems to have a lot of momentum, with many new features, releases, active communities on GH and Discord. I expect it to continue to get better. | |
| ▲ | the__alchemist 14 days ago | parent | prev [-] | | Have not heard of it. Looked it up. Seems orthogonal? I am using Cudarc. |
|
|
| ▲ | taminka 14 days ago | parent | prev [-] |
| even putting aside how rust ownership semantics map poorly onto gpu programming, ml researchers will never learn rust, this will never ever happen... |
| |
| ▲ | pjmlp 14 days ago | parent | next [-] | | While I agree in principle, CUDA is more than only AI, as people keep forgetting. | | |
| ▲ | taminka 14 days ago | parent [-] | | everyone else who uses cuda isn't going to learn rust either | | |
| ▲ | pjmlp 14 days ago | parent [-] | | First Rust needs to have tier 1 support for CUDA, in a way that doesn't feel like yak shaving when coding for CUDA. |
|
| |
| ▲ | int_19h 14 days ago | parent | prev | next [-] | | The ML researchers are relying on libraries written by someone else. Today, those libraries are mostly C++, and they would benefit from Rust same as most other C++ codebases. | |
| ▲ | malcolmgreaves 14 days ago | parent | prev | next [-] | | ML reachers don’t write code, they ask ChatGPT to make a horribly inefficient, non-portable notebook that has to be rewritten from scratch :) | | |
| ▲ | staunton 14 days ago | parent [-] | | It's made easier by that notebook only having to work just once, to produce some plots for the paper/press release/demo. |
| |
| ▲ | saagarjha 14 days ago | parent | prev | next [-] | | I don’t think this is true. It seems to me more that nobody has put in a serious effort to make a nice interface build using Rust. | |
| ▲ | the__alchemist 14 days ago | parent | prev [-] | | GPGPU programming != ML. |
|