This actually proves the hardest part of software engineering is defining requirements.

That makes it sound like a PM problem. The hardest part is building the mental model which doesn't crumble. I have worked with humans who had the same failure modes as LLMs.