Remix.run Logo
dorolow 2 hours ago

I am an AI Safety Person and I want the government to nationalize or have a significant stake in the frontier labs and to have democratic control of the development of the technology. The AI Safety movement is not a monolith. I do not think Eliezer Yudkowsky nor his acolytes should hold the reins, but a lot of folks sure like to create a strawman that anyone who wants to regulate OpenAI is somehow an EA/MIRI weirdo

api 2 hours ago | parent | next [-]

Yes I trust this government with that power. /extreme sarcasm

nialv7 2 hours ago | parent | next [-]

Yes I trust sama/dario/elon with that power

/even more extreme sarcasm than you

bigyabai an hour ago | parent | next [-]

I don't trust them, which is why I inherently question the validity of their RSI/bioweapon/extinction claims.

syrrim an hour ago | parent | prev [-]

You trust trump more than any of those three? Really?

Marsymars 40 minutes ago | parent [-]

You can have an arbitrarily low opinion of Trump and still trust in democracy as a form of government over autocracy or oligarchy, which is what the AI labs have.

dorolow 2 hours ago | parent | prev [-]

That's an extremely fair objection! But despite the many, many flaws of our government and the current administration, I still have (hopefully) a chance to vote them out of power. I have no such hopes with Sam Altman or Elon Musk.

bigyabai 2 hours ago | parent | prev | next [-]

> and to have democratic control of the development of the technology

Why? I don't care about democratically participating in a closed model's development. It doesn't belong to me.

China will develop whatever they want, a federal stake in OpenAI or Anthropic punishes Americans and shields US labs from legitimate competition.

dorolow 2 hours ago | parent [-]

In my mind, democratic control of the technology means that we (the govt, or other empowered agency) take ownership of their assets and IP, solve or find a level of alignment or guardrails that society is comfortable with. Then we distribute the technology, or access to it, to avoid power concentration. This would also certainly require international coordination with China on a slowdown or pause, which I think is possible.

pibaker 2 hours ago | parent [-]

> This would also certainly require international coordination with China on a slowdown or pause

Personally I think the country with a strictly meritocratic elite selection system that also just outright kills you if you sell weed will have a hard time sympathizing with Bay Area thinkers who talk about AI killing us all during their ayahuasca breakfast before returning to their meth fueled crunch towards releasing the next version of the AI that will kill us all.

derektank 28 minutes ago | parent | next [-]

>I think the country with a strictly meritocratic elite selection system

Not really relevant to the broader discussion, but this simply isn’t an accurate description of China. Starting with the gaokao, admission quotas are set by province and admits to Peking university and Tsinghua are disproportionately from the urban professional class. Candidate party members must be politically vetted, which means that people whose families have expressed anti-communist views, are members of banned organizations (e.g. falun gong), or have substantial criminal records will not be permitted to advance. And once you make it into the party and enter political service, your advancement relies upon opaque patronage networks that someone without connections is unlikely to be able to navigate, even if they successfully satisfy the economic metrics the state assigns them.

I don’t want to overstate this, the Chinese system does filter out a lot of chaff and the current Chinese leadership has a lot of very capable people in positions of power. But I do not think it is substantially more meritocratic than Western political institutions

dorolow an hour ago | parent | prev [-]

You're in luck, neither I nor anyone else want those people near a negotiation table.

nradov 2 hours ago | parent | prev | next [-]

Yikes. Hopefully you never gain any power or influence. The last thing we need is more economic central planning. I sincerely hope that you fail.

dorolow 2 hours ago | parent [-]

Do you think things like the Manhattan Project were a mistake? Comparing AI to nuclear weapons is perhaps a stretch, but I think most people recognize that certain technologies or artifacts are best monopolized by our governing bodies. I think if the capabilities of AI systems keep growing on trend, it is not unreasonable to think wonton usage could disrupt society or cause mass harm.

CamperBob2 2 hours ago | parent | prev [-]

to have democratic control of the development of the technology

Not super interested in what the people who elected Donald Trump POTUS twice think about AI.

(Of course, with Musk and Brockman in the C-suites at two of three major labs, that's what we'll get either way.)

dorolow 2 hours ago | parent | next [-]

Fair objection, but I still think it is lower risk to diffuse power and control of a potentially dangerous and revolutionary technology than to leave it in the hands of the few elites who have not show much ethical integrity so far.

howunfortunate 2 hours ago | parent | prev [-]

Is Greg Brockman right wing?

CamperBob2 2 hours ago | parent [-]

He's the largest single private donor to the Trump 2024 campaign, as I understand it, at $25 million.

howunfortunate 2 hours ago | parent [-]

Interesting, I did not know this.