They should at least stop responding in the first person.

That's one of the first instructions in my system prompt when I'm working with an LLM:

> Do not reply in the first person – i.e. do not use the words "I," "Me," "We," and so on – unless you've been asked a direct question about your actions or responses.

It's not bulletproof but it works reasonably well.

We need to make like Japanese and come up with some neo-first-person-pronouns for bots to use to refer to themselves.