If we accept the premise that people will increasingly become emotionally attached to these models, it begs the question what will be the societal response to models changes or deprecation. At what point will the effect be as psychologically harmful as the murder of a close friend.

The ability to exploit the vulnerable feels quite high.

That already happened with the release of GPT5.