Have I got a book for you: https://en.wikipedia.org/wiki/The_Unaccountability_Machine

Not actually about technology at all, but about organizational structure.

I think the "black box" framing that it uses neatly applies the same theory to organizations and ais. It doesn't matter whether there's technological or organizational reasons inside the black box to dodge accountability, the outcome is the same.