Well if you want to rewrite something like the PHP engine then you can obviously prompt the LLM to test against the existing legacy engine. You don't necessarily want to rewrite it 100% compatible because the goal is to avoid recreating the same security bugs, but it gives you a pretty good starting point.

LLMs still make mistakes, but generally fewer security mistakes than human developers.