Remix.run Logo
caderosche 4 hours ago

What is the purpose of the Rust WASM parser? Didn't understand that easily from the article. Would love a better explanation.

joshuanapoli 3 hours ago | parent [-]

They use a bespoke language to define LLM-generated UI components. I think that this is supposed to prevent exfiltration if the LLM is prompt-injected. In any case, the parser compiles chunks streaming from the LLM to build a live UI. The WASM parser restarted from the beginning upon each chunk received. Fixing this algorithm to work more incrementally (while porting from Rust to TypeScript) improved performance a lot.