“In Rust” man of all the cliche title baits, I hate this one the most.

Why did you choose Rust? Why does that matter?

Nothing wrong with Rust. Lots wrong with the bandwagon that “in Rust” somehow adds value.

Rust has its place but python is default for this kind of thing. By doing it in rust, they have now changed two things: the implementation of the transformer, and this new model.

Counterpoint: I only clicked on it because it said "in Rust".

Yeah I read the title and did a double-take. It's an uninteresting choice for systems like these. The more pressing concerns, which go undescribed, are the exact mathematical choices behind the actual model. Rust provides almost zero value here because tensor stuff is all just 2d-arrays of floats for the most part.