I’m not GP, but I’d argue that “making frontier AI models more offensive in black hat capabilities” is a thing that’s going to happen whether we want it or not, since we don’t control who can train a model. So the more productive way to reason is to accept that that’s going to happen and then figure out the best thing to do.

▲

whimsicalism 18 hours ago | parent [-]

I think this is a popular rhetorical turn nowadays but I actually don’t agree at all - relatively few actors have the ability to train top models.

▲

freedomben 14 hours ago | parent | next [-]

It only takes "relatively few" to be a huge problem. Most serious threats come from nation states and criminal gangs, and they definitely do have the ability and resources to train top models. Beyond that though, I would bet many of the nation states even have access to a version of OpenAI/Google/etc that allows them to do this stuff.

▲

flir 16 hours ago | parent | prev [-]

Can't we be pretty sure it will only get easier, and more common?

	▲	whimsicalism 16 hours ago \| parent [-]
		why does that mean we should do it now?