If you genuinely believe this, why on earth would you work for OpenAI etc even in safety / alignment?

The only response in my view is to ban technology (like in Dune) or engage in acts of terror Unabomber style.

> The only response in my view is to ban technology (like in Dune) or engage in acts of terror Unabomber style.

Not far off from the conclusion of others who believe the same wild assumptions. Yudkowsky has suggested using terrorism to stop a hypothetical AGI -- that is, nuclear attacks on datacenters that get too powerful.

Most people work for money. As long as money is necessary to survive and prosper, people will work for it. Some of the work may not align with their morals and ethics, but in the end the money still wins.

Banning will not automatically erase the existence and possibilty of things. We banned the use of nuclear weapons, yet we all know they exist.