Remix.run Logo
▲ hansvm a day ago

But what made "better not leak" challenging? I ask because it looked like you were positioning "incredibly complex CV pipeline in Zig" as a counterpoint to my claim that LLMs are bad at memory management. I still think they're bad at it, but I'm interested in evidence to the contrary, so I'd love to know why your application rises to the level of something I should expect an LLM to struggle with. I've seen (have in prod right now actually) relatively simple ideas not much more complicated than resetting an arena each request, which would paper over a lot of memory-management sins even with quite bad models. I'm curious if that's why the LLM did well or if there's something else going on.