Remix.run Logo
▲ Aurornis an hour ago

> The issue would have been, for the AI bosses, that this takes time and doesn't create trillion dollar companies. It only creates companies that they'd actually have to run, long term, and that's boring.

I feel like you’re not acknowledging the inevitability of the technology being developed further. You’re also ignoring competition and the basic fact that people do research and push the boundaries of their field naturally.

If the major frontier AI labs had decided, as you said, to make a fancy autocomplete and a better Grammarly and then simply stop and coast, do you really believe that every AI researcher and entrepreneur in the entire world would look at the situation and decide that the status quo is where it should end?

Humans don’t work that way. People would get ideas and want to push the limit. If the frontier labs stopped developing their technology, other companies would be created to carry on. Academic researchers would push the limits further. It would be discovered that the AI could go further and we’d get back to this same eventuality with a different set of people leading it.

I also disagree with your characterization of this as a get rich quick scheme for AI leaders who want to make a lot of money and then be done. I think this characterization feels truthy if your only conception of startups is as a gamble to retire early, but the people who build and run these companies actually do like building and running companies. If the AI leaders and executive management you’re talking about were separated from their jobs today, even with billions of equity, most of them would be out starting new companies next month because that’s what people like that do. I’m not saying this to “glaze” them or whatever I’ll surely be accused of in the comments, I’m stating some facts about this space. You don’t need to look far to find examples of this already happening.

▲rafterydj an hour ago | parent | next [-]

I really don't like the excuses that are inherent to the "well it was inevitable" line of thinking. Oppenheimer was still responsible for the bomb despite it being "inevitable" in a similar way.

Despite this, when discussing the egregious behavior of the frontier labs, there is vanishingly little acceptance of the idea that 1) yes, it probably was inevitable in some ways AND 2) those involved, particularly at the top, are still responsible for the consequences of their (bad) decisions.

▲mchusma 34 minutes ago | parent | next [-]

I am not sure what gripe you have with the labs, but I think if you are worried about AI then you got shockingly lucky with the lab leadership. My biggest gripe has been the campaign of negativity against ai.

▲WarmWash 4 minutes ago | parent [-]

>campaign of negativity against ai.

People are starting to panic, and few things bring out full blown idiocy and disregard for ground truth faster than widespread panic.

▲pyyxbkshed 42 minutes ago | parent | prev | next [-]

I have also not been able to lean towards a side in inevitable v/s responsible.

1. Is it both inevitable and still they are responsible? 2. Or it was inevitable and they were just an instrument to make it happen. 3. Or it wasn't inevitable and if it were not for some specific people then it would not have happened?

I am leaning more towards 2. But if that is the case why are only specific people reaping the benefits of this?

If it is 3 or 1, then why aren't we holding them accountable?

▲watwut 34 minutes ago | parent [-]

"Inevitable" means "same technological progress would be achieved anyway, even if these people have made less damaging choices".

So yes, they are 100% responsible for damage they caused and did not had to happen. And no, "I had no choice, because it was the only way to become billionaire" is not an excuse.

They were NOT "instrument". No one manipulated them. No one forced them. Nothing forced them. They themselves wanted to and did not cared

▲gizajob 17 minutes ago | parent | prev [-]

“I am become death, the destroyer of copyright”

-G. Hinton

▲knottn an hour ago | parent | prev | next [-]

“not acknowledging the inevitability of the technology being developed further”

This looks a lot like the “if I didn’t do $badthing someone else would have” line of reasoning.

▲bensyverson 32 minutes ago | parent | next [-]

Just to flip it around on you, what do you think would happen if Anthropic and OpenAI agreed to stop working on AI altogether?

I'm not arguing about the consequences or responsibility. I'm asking which humans would be capable of stopping the development of AI at this point in history.

▲orsorna an hour ago | parent | prev | next [-]

This was the logic for developing the atomic bomb and it was a good call.

▲josephg 41 minutes ago | parent [-]

Was it? We nearly destroyed ourselves with nuclear weapons several times in the last century. I don't think it was a good call just because we've gotten lucky so far.

▲Aurornis an hour ago | parent | prev [-]

Academic research has always progressed and pushed the boundaries. Is that a $badthing to you?

▲josephg 44 minutes ago | parent | next [-]

Imagine a bag filled with marbles. We can't see inside the bag, we can just pull marbles out of the bag. Some marbles are white - they improve the world in some way. Wifi. Trains. Electricity. Some marbles are grey - they are useful but dangerous. Firearms. Nuclear weapons. Gene editing. And some marbles are black. If we pull a black marble out of the bag, we hurt or destroy ourselves.

Humanity's strategy so far has been to pull marbles out of the bag as fast as we can. And that's been working out, because most marbles are white. But we're insanely lucky we haven't had a nuclear war. The USSR's early warning systems picked up 5 incoming american missiles in 1983. They didn't fire back because one of the officers on shift didn't believe the reports (why only 5 missiles?), and he declared the reports were fake.[1] If a different person was on shift, there's a good chance nuclear war would have broken out because of a sensor glitch. And that's far from the only instance. The list is terrifying: [2]

And now we're improving AI capabilities as fast as we can, despite it being pretty clearly another grey ball. AI has a lot of amazing uses. But why are we rushing so much? Doesn't seem wise.

[1] https://en.wikipedia.org/wiki/1983_Soviet_nuclear_false_alar...

[2] https://en.wikipedia.org/wiki/Nuclear_close_calls

▲Aurornis 31 minutes ago | parent [-]

> Humanity's strategy so far has been to pull marbles out of the bag as fast as we can.

> But why are we rushing so much?

Talking about these things with elaborate analogies only obscuring the point you already stumbled into: Humanity advances because humans are curious, driven, like to discover things, and like to push the boundaries.

Talking about humanity like one entity that operates together misses the point: There are billions of people in the world and some of them are going to discover new things.

There is no general counsel where humanity gets together and decides what humanity works on. There is no singular bag with a singular “humanity” pulling marbles out one at a time.

The analogy is too broken to be useful for the discussion.

▲Loquebantur an hour ago | parent | prev | next [-]

It's not about merely knowing how to build a "badthing". It's about knowing why not to.

With AI, the point is who uses it for what.

Think about it like a magic wand that makes your wishes come true. Would you really want everybody to have one? Who should and who shouldn't? Who gets to decide?

▲miltonlost an hour ago | parent | prev [-]

And this sort of blanket argument is how you get bad science on the order of Prison experiments to Nazi scientists. Yes, academic research that pushes boundaries can be a $badthing

▲Loquebantur an hour ago | parent | prev [-]

You operate within the "logic" of capitalism, where no other value exists but the (short term) economic one.

AI indeed goes far beyond "autocomplete" and other nonsense. But the question is, whether it's a good idea to just let the "market" run wild with it.

Short-term capital interests don't align with the public good. AI greatly scales capability, but without anything to restrain it, that implies those non-aligned interests overwhelming society's defenses, outright destroying it in the process.

The idea of rich people being some kind of benevolent caretakers, who independently and dependably foresee and manage the consequences of their actions in everybody's best interest, is laughably wrong already.

With AI, that reality gap will swallow whatever is left.

▲Aurornis 38 minutes ago | parent | next [-]

> You operate within the "logic" of capitalism, where no other value exists but the (short term) economic one.

I operate within the logic of how the world actually works.

Which I find infinitely more useful for practical topics like the reality of AI development in a global economy.

Fantasizing about alternative realities where all the leaders of the world unite and halt technology development without any of them secretly defecting and developing it further isn’t very useful to discuss. These things aren’t going to happen.

▲nananana9 16 minutes ago | parent | next [-]

You're acting like international treaties (or cartels) don't exist. Yes, these are structures where parties have incentives to defect, and we counter those by creating incentives not to, with checks and sanctions.

Additionally, you don't need all the leaders of the world to agree to anything, you only need US and China.

Additionally x2, if you agree with the common stance that China makes the vast majority of their progress by distilling US models, you don't even need them to agree to anything.

▲Loquebantur 25 minutes ago | parent | prev | next [-]

The "world" isn't just what humans currently make of it. You deny the possibility of alternatives for society based on what amounts to ignorance.

Transitioning from the current "order of things" to one compatible with the existence of things like AI is a necessity, not a "fantasy".

When you imagine people as savages to be outdone in their savagery, you become one yourself. Spend more effort on finding ways not to.

▲Aurornis 16 minutes ago | parent [-]

> The "world" isn't just what humans currently make of it. You deny the possibility of alternatives for society based on what amounts to ignorance.

Ignorance of what? All of the previous successful attempts where the entire world reorganized itself into a single world government?

> Transitioning from the current "order of things" to one compatible with the existence of things like AI is a necessity, not a "fantasy".

I think you’re putting the cart before the horse. You’re assuming it’s necessary and then making another leap to assume that being necessary means it must also be possible.

▲sznio 31 minutes ago | parent | prev [-]

>Fantasizing about alternative realities where all the leaders of the world unite and halt technology development without any of them secretly defecting and developing it further isn’t very useful to discuss. These things aren’t going to happen.

it has kinda worked for nuclear weapons

▲defen a minute ago | parent | next [-]

"We" (Israel, probably with US assistance) assassinate "rogue" (outside of existing nuclear powers) nuclear scientists (e.g. from Iran). So to take this analogy to its conclusion you have to accept that part of the pact would be assassinating people for doing computer science research or building computer systems that will be used for AI.

▲Aurornis 19 minutes ago | parent | prev [-]

In the nuclear case multiple powers raced to develop it as fast as possible and as much as possible.

That’s the inverse of what I said.

▲hogs_get_fat an hour ago | parent | prev | next [-]

The market is irrelevant. In the 28 centuries of recorded history, the human race has pursued power in it's various forms (political, military or economic), without regard to the "public good" (which is really, just a polite euphemism for the established order and those that benefit for it).

Without capitalism, you wouldn't be able to restrain AI adoption any more than the armored knights of the middle ages were able to restrain the adoption of the firearm.

▲ford an hour ago | parent | prev [-]

Capitalism isn't the most palatable economic system, it's the one that best matches the reality of nature (competition)

I think the vast majority of the rich are greedy bastards, but IMO being rich does not imply greedy bastard 100% of the time.

▲gilrain 43 minutes ago | parent [-]

> it's the one that best matches the reality of nature (competition)

This doesn't seem right: it doesn't match the history of reality, in which capitalism has repeatedly stymied rather than fostered competition.