3) AI produces black swan events every n runs and eats up a significant portion of the gaina.

I wouldn't call them black swan events. LLM oopsies are a couple orders of magnitude more likely than black swan events.

Reliability and competence (or the lack thereof) is a real issue but separate from the societal impact.