A severe mental illness of course but would you say the same if the whole process was done by a person instead of a machine? That there wasn't a problem that someone led a person with severe mental illness to their suicide, even having a countdown for it?

That's the kind of stuff where safety should be a priority, and the only way to make it a priority is showing these corporations that they are financially liable for it at the bare minimum. Otherwise there's no incentive for this to be changed, at all.

If a human would go to jail for this then at least one or more humans at google should go to jail for it. "Our AI did it, not us!" should never be allowed to be an excuse.