Yeah but the scale of the damage possible by OpenAI and Anthropic is drastically disproportionate to the scale of damage me or you could make on our own as well. They should definitely be held to a much higher standards. They have hardware capacity to really do some damage.

In large scale operations, large scale errors happen. Minor radiation leak in a nuclear powerplant is happening weekly. That same leak at your shed would be a major reason for alarm.