Remix.run Logo
OpenAI's Misalignment Framework: A Tactical Bid to Preempt Global AI Governance(asiaai.fyi)
21 points by ghernando an hour ago | 22 comments
nullbio 2 minutes ago | parent | next [-]

We have no reason to believe a word they say. We know they're incentivized to lie about "dangers" and act alarmist, Anthropic has been doing it for years now. Aside from that, just because you can burn down a village doesn't mean fire is the devil. Maybe they should consider acting responsibly.

pcestrada 36 minutes ago | parent | prev | next [-]

OpenAI and Anthropic should be nationalized. I find it difficult to trust Sam Altman or Dario Amodei.

indymike 21 minutes ago | parent | next [-]

I find it even harder to trust elected leaders from any party. At least Sam and Dario are aligned with a value set that is understood and clear, whereas political leaders values changes as do the polls their livelihood depends on changes.

swatcoder 7 minutes ago | parent | next [-]

> At least Sam and Dario are aligned with a value set that is understood and clear

What value set do you perceive that to be, and why would you take your perception of it to be any more sound than it would be with a politician?

It's not like someone can operate companies of that scale, especially startups, through earnestness and openness. Like national politics, their job is fundamentally about perception management and power brokering across dynamic windows of opportunity. Nothing they say or do can be taken at face value, and you can't reduce their incentives to either company or personal profit in any particular form over any particular time scale.

pixl97 3 minutes ago | parent [-]

>What value set do you perceive that to be

A meat based paperclip maximizer.

ceejayoz 18 minutes ago | parent | prev | next [-]

> At least Sam and Dario are aligned with a value set that is understood and clear…

How could we possibly know this?

jsrozner 8 minutes ago | parent | prev [-]

No system of governance can deal with immense concentration of power. The US Constitution was about separation of powers. Democracy is about (in theory at least) giving each person a meaningful say in their own governance, which in turn implies not allowing any single person to become too powerful.

Political leaders become a problem when they amass too much power. Corporations become a problem when they amass too much power. It doesn't matter what Sam and Dario's purported values are. They aspire to power and absolutely power always corrupts absolutely.

Technologies which are infinitely powerful or whose power grows too quickly outrun any reasonable attempt at regulation. If you imagine that tomorrow everyone were given a tank, we might think, "alright, everyone has a tank so it's not too bad." But humans are squishy, and our houses are (relatively) squishy compared to tanks. Substantial collateral damage would result from everyone having a tank, and it seems likely that substantial collateral damage will result from everyone having a cyberterrorism-capable slop machine.

luqtas a minute ago | parent [-]

> Democracy is about (in theory at least) giving each person a meaningful say in their own governance, which in turn implies not allowing any single person to become too powerful.

this is "direct democracy" and it's not even close to exist in USA... even with that a society can allow powerful people to exist if they don't create any law forbidding that

cmrdporcupine a minute ago | parent | prev | next [-]

The nature of the US state is such that the distinction between nationalized and not is meaningless.

Like Lockheed-Martin or Boeing, etc. there's just interpenetration between the corporate boardroom and the state. They act in each other's mutual interests.

The Chinese system is just more explicit and open about this.

And as a non-American, I can't trust the US state anymore than I can trust its dominant corporate entities. So I fail to see the advantage to the world.

prettyblocks 28 minutes ago | parent | prev | next [-]

I guess that's one way to guarantee development slows down to a crawl, but in no way would it increase trust.

bibimsz 22 minutes ago | parent [-]

why would that be the case? it's not true for top secret defense contractors today. and the frontier labs already operate in the dark, openness is a liability.

nationalization to me simply means the government is their main customer and stakeholder, and shield them from liability, governance, and openness. not that the frontier labs become part of the government per se.

manav 34 minutes ago | parent | prev | next [-]

and you trust the government?

klaff 24 minutes ago | parent [-]

not this one

vb-8448 31 minutes ago | parent | prev | next [-]

Even better: force them to release weights.

bibimsz 21 minutes ago | parent [-]

who even has the inventive to do that? certainly not the government.

binlog 15 minutes ago | parent | prev | next [-]

Makes sense let’s trust Donald Trump instead

greenmilk 3 minutes ago | parent [-]

a maliciously engineered dichotomy

bibimsz 25 minutes ago | parent | prev [-]

they will. to shield from oversight, liability and profitability concerns, and to ensure unimpeded rapid development, with the frontier only being available to elite (not you). definitely not to add transparency.

the frontier labs are the new top secret defense contractors.

bix6 37 minutes ago | parent | prev | next [-]

> The company released six internal case studies where none of the issues affected real users.

This is the most interesting point to me. What are they not releasing that has affected real users? We’ve seen some individual reports from people (eg AI wiped my HD).

skybrian 23 minutes ago | parent [-]

Imagine how pervasively they'd have to monitor what their users are doing to pick up on that whenever it happens. The people affected that way will have to report on it themselves.

(OpenAI does occasionally report on malicious use though. [1] That shows they do some monitoring.)

[1] https://openai.com/index/disrupting-malicious-ai-uses/

carterschonwald 20 minutes ago | parent | prev | next [-]

i think the lower bound on the end state is there cant be opaque reasonibg steps ever.

27183 4 minutes ago | parent | prev [-]

What's with all this make believe delusional bullshit? The LLM is not gonna wake up and become AI. Get real guys.