Would you feel similarly if microphones were installed everywhere to record all public conversations for analysis via algorithms? Is that the same as police officers listening to conversation in a public space and taking notes?

That is unfortunately already sort of a thing. A ShotSpotter-recorded conversation was already used as evidence at least twice.