▲ | rurban 4 days ago | ||||||||||||||||||||||||||||||||||
Which was the ultimate failure of Rust, because as Pony benchmarks have shown, you get safety and speed by proper security and architecture. Rust just survived by lying about the its safeties. What kills performance are not memory copies, but locks. Parallel nonblocking IO and a non POSIX stdlib will bring you far away from C++ or Rust performance. | |||||||||||||||||||||||||||||||||||
▲ | kllrnohj 4 days ago | parent | next [-] | ||||||||||||||||||||||||||||||||||
> What kills performance are not memory copies, but locks. I'm pretty sure if every thread executing an LLM model had to have its own copy that that would murder performance more than any lock does, and it won't even be close. It's cheaper to copy than to lock when the data is small, but that does not scale and it also ignores things like reader/writer locks where the data is primarily read-only, at least during the concurrent stage. Or where the work can be safely chunked up such that writes don't ever overlap which is very common in graphics | |||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||
▲ | littlestymaar 4 days ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||
Oh yeah, the “ultimate failure of Rust”, and tell me how industrially successful Pony has been compared to Rust? (Don't get me wrong, I liked the idea behind Pony for backend code, it's much saner than Go for the same target space. But it failed to capture that market, because Go was already there. And it was never a competitor to Rust because this model is only viable for web back end tasks, not for general computing). | |||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||
▲ | kobebrookskC3 4 days ago | parent | prev [-] | ||||||||||||||||||||||||||||||||||
> Rust just survived by lying about the its safeties. strong claim. care to back it up? |