This is true of code, as well. LLMs have a strong tendency to make suspiciously prompt-shaped comments and code. "This deliberately does not do X". "This is kept in its own module rather than put in module M because". They act like they're responding to a conversation that's no longer there.