hmm almost like the exact race-to-the-bottom + arms-race dynamic all the doomers have been warning about

andrewmutz 2 hours ago | parent | next [-]

One man's offensive penetration tool is another mans defensive tool. In the recent HuggingFace/OpenAI incident the safety controls stood in the way of the defenders, not the attackers:

https://www.thestack.technology/hugging-face-hacked-turned-t...

▲

estearum 2 hours ago | parent [-]

You're presenting further evidence of lack of effective control over these systems as... a mitigating factor...?

▲

ekidd 42 minutes ago | parent | next [-]

Apparently, the attacker in the Hugging Face case was reported to be an internal OpenAI model trying to break into HF and steal the answers to cybersecurity benchmarks: https://openai.com/index/hugging-face-model-evaluation-secur... It really doesn't matter what restrictions are placed on public use of models if the attacking models are internal models at the AI labs themselves.

So if the AI labs are literally running rogue models breaking into other organizations' servers, then yes, I am OK with those organizations self-hosting Chinese models for defensive use.

▲

californical 2 hours ago | parent | prev [-]

Why do you assume they're disagreeing with you?

	▲	estearum 2 hours ago \| parent [-]
		> One man's offensive penetration tool is another mans defensive tool. seems to suggest the author believes there's some intrinsic equilibrium Which, 1) is definitely not proven and not guaranteed (open to proofs otherwise, not pithy sayings that have zero normative effect on reality) 2) is apparently "supported by" further evidence of lack of effective control, which does not feel like equilibrium whatsoever

▲

toomuchtodo 2 hours ago | parent | prev | next [-]

Race to the bottom for the investors, utility for the rest of us. The future is already here, it’s just not evenly distributed yet (Gibson).

▲

skinfaxi 2 hours ago | parent | prev [-]

Doom for whom?

	▲	estearum 2 hours ago \| parent [-]
		Well considering it was just a few months ago that OpenAI had the brilliant idea of connecting these systems to autonomously run an actual protein synthesis wetlab, very possibly all of us.