A sibling comment includes an important rider to the provision: "...in any manner in which it may be viewed by another person." If you wrote this in a google doc, it almost certainly would not qualify as a threat under this statute. Even though google docs, like LLM chats, have administrative override and you could look at their contents - you would not expect either to be "viewed by another person."

IMO I do not think this is a grey area and it's legal to tell a LLM you want to kill someone. It's certainly not a "threat" like you might send to another person, though it may end up being evidence of conspiracy or premeditation. I suspect we would be well served to, after a few years of experience, put together some laws governing when LLM chats must be made available to authorities.

It is very interesting that the LLM responses to these lines - the context around what she is saying - is not in the article. I suspect, as is the case in many instances where LLMs are involved in violent planning, that the LLM was urging this behavior on. Basically entrapment - you are encouraged by a robot to become more violent and vindictive and then when you do you are handed over to police.

I do take your point. But I would also ask you to imagine that instead of threatening to mass murder a bunch of people she was just creating text based csam. Still, all of what you said applies, but clearly she would be prosecuted over this victimless crime and the jurisprudence in fact disagrees that it would be victimless. So applying that reasoning to this act she clearly committed the crime (legalese notwithstanding). The fact that threatened mass murder doesn't trigger the same thought process is, well at least interesting to me.