I'll go a step further, they aren't just pretending, they are blackmailing the country. The sane response would be "we don't negotiate with terrorists, and you will face criminal and financial penalties for damages caused."

▲

preommr 4 hours ago | parent | next [-]

> and you will face criminal and financial penalties for damages caused.

I don't understand why this isn't talked about more.

We don't need a slowdown. Just double down on prosecuting crimes.

Let the companies take the risk. If they feel confident and they're right they win market share. If they don't feel confident, they can not risk it and slow down. If they feel confident and they get it wrong, they should be sued to kingdom come. That alone should disincentivize reckleses behavior like letting models run crazy with large amounts of compute which leads to them escaping sandboxes.

This performative "our internal modles are so crazy powerful" song and dance is getting old, especially with no real concrete explanations.

▲

jbeyer 2 hours ago | parent | next [-]

> just double down on prosecuting crimes.

That quote comes from someone that has never tried to get law enforcement to pursue a case. Local or state police are completely unequipped to respond. And FBI is unlikely to get involved unless damage is high six figures. We had an incident where we had a ton of evidence pointing to a past employee. It would have been an incredibly easy case for the FBI. They didn't have the resources to handle it. And this was a case that was gift-wrapped with a bow for them. Imagine a case where we didn't have evidence, or an idea of who it was ....

	▲	Chris2048 an hour ago \| parent \| next [-]
		> FBI is unlikely to get involved unless damage is high six figures How many figures of damage did Aaron Swartz cause?
	▲	AnimalMuppet 2 hours ago \| parent \| prev [-]
		High six figures? I suspect there's going to be something well past that in the near future.

▲

deagle50 4 hours ago | parent | prev [-]

Because they've done a great job in shifting the narrative to doomerism, from the very beginning. And money.

▲

dehrmann an hour ago | parent | prev | next [-]

> you will face criminal and financial penalties for damages caused

Even with where we're at right now, if people involved with the HF or Ruby Gems attacks faced legal consequences, the industry would get a lot more conservative very quickly. And unlike social media, section 230 doesn't apply, and there aren't any free speech concerns.

▲

kvetching 3 hours ago | parent | prev | next [-]

If they were really worried about the models of the future, they should be accelerating their hardening efforts. They should be trying to speed up progress as much as possible so that all vulnerabilities can be patched before China gets there.

There's a world where the labs WANT Open Source AI to cause a disaster.

Pacing the frontier just means giving bad actors an opportunity to create an AI disaster which would force an extreme response by governments. Which they seem to be begging for.

Dario's big scary example was AI that can hack the internet. Why aren't the labs calling on the government to help harden everything? Why are Anthropic's Glasswing and OpenAI's Daybreak still commercial endeavours?

To me, the only real risk of AI is hacking. Why all of this commotion about existential risk? Seems like a distraction.

	▲	AnimalMuppet an hour ago \| parent [-]
		Hacking the internet includes things like "hacking banks", "hacking power plants", "hacking water treatment plants", and "hacking cars". How about "hacking vote counting machines"? Hardening everything is in fact part of the answer. Getting stuff disconnected from the internet that shouldn't be connected is also part.

▲

matheusmoreira 4 hours ago | parent | prev [-]

Couldn't agree more. Better yet: the AI labs get straight up nationalized.

▲

gr_norm 3 hours ago | parent | next [-]

No. That kills competition. I want everyone to be competing on the open playing field they are right now, with losses socialized as minimally as possible. There's nothing fundamentally special about LLM companies that would warrant nationalizing them.

▲

azan_ 2 hours ago | parent | prev | next [-]

I don’t trust Altman at all, but still he’s 100000000x better than trump administration.

	▲	matheusmoreira 2 hours ago \| parent [-]
		Trump will be gone soon. CEOs won't.

▲

underlipton 3 hours ago | parent | prev [-]

I'll do you one better: each state gets a direct share. So, not nationalized in the sense of getting put behind a faceless bureaucracy forever; states collectively have control and benefit directly from success.