The other thing with the AI debate is that it's nothing new- these kinds of failures are the same kind that have been going on for a long time, for the exact same reasons.

Any time a local government fails people these same kinds of incentive misalignments are at the real heart of it.

The fact that it has the word AI in it just gives it that cool cyberpunk dystopian sheen, where you call 911 and the AI says something about mechahitler instead of trying to help you.