One man's offensive penetration tool is another mans defensive tool. In the recent HuggingFace/OpenAI incident the safety controls stood in the way of the defenders, not the attackers:

https://www.thestack.technology/hugging-face-hacked-turned-t...