If they aren't competent to run the evals safely, then they shouldn't run them.

The huggingface incident seems to have resulted from them partially mirroring a repository, but for no reason I can see not fully mirroring it, after which they could have unplugged the ethernet cable. This is just stupid.

Yes, they're stupid. Maybe also highly intelligent. But stupid.

Also irresponsible.