yeah, not sure what the right answer here is... but it definitely isn't "trust us, we would never lie (fingers crossed behind back)".

What does a non-AI company do? If I emailed Tim Cook and said I had a gun and was coming for him, I imagine Apple would turn the email over to their security team, who would then go to the local PD/FBI/whoever. I'd expect the same here, at least for anything that resembles a direct threat.

This isn't quite into the pre-crime sci-fi zone yet, IMO. That would be more like "this guy bought a gun, then bought gas out of state, then did something else, therefore he must be planning an assassination". Unfortunately, I expect this situation will end up reported as well, and the police, looking for work to do, will take it as gospel and charge ahead without a second thought (like the recent journalist with a "bad" (aka fat-fingered) license plate).