Remix.run Logo
▲ lelanthran 19 hours ago

> Maybe Chinese AI will be banned, maybe Anthropic & OpenAI go bankrupt.

Unless the entire world bans it, how would that help?

▲horsawlarway 19 hours ago | parent | next [-]

It wouldn't, it would just mire the US in an unproductive and isolationist quagmire - reducing our global competitiveness because every US company would be paying an "anthropic tax" for a service that competing countries access for much lower costs.

▲randomNumber7 18 hours ago | parent | next [-]

I agree, but the US would likely coerce the EU to do the same. So they still could outcompete some countries.

▲SoftTalker 18 hours ago | parent [-]

The US has burned a lot of goodwill with the EU. Though the threat of Russia might still be worth something.

▲distances 2 hours ago | parent [-]

I don't want to make this yet another geopolitics subthread, but I don't think anyone sees Russia as a credible threat to EU. They are losing (for certain values of losing, anyway) against Ukraine as we speak.

▲LeFantome 18 hours ago | parent | prev [-]

How do you spell “unproductive and isolationist quagmire”?

U-S-A

▲FunkyMushroom 19 hours ago | parent | prev | next [-]

The absurdity is the point; The clear-cut ways to resolve the tension of "AI giants need pricing power but don't have it" are absurd (admittedly, the former much more so than the latter)

It's hard to predict an outcome "somewhere in between of two absurdities"

▲bryanlarsen 17 hours ago | parent | prev | next [-]

If the US actually wanted a world-wide ban, it would probably happen.

Obviously we can't effectively ban already released models, but a ban on models with >10T parameters for instance, is quite feasible. It takes a ton of power to train and operate those, and infrared satellites can spot that.

I'm confident China would be very happy to sign on to a world wide ban.

1. AI is one of the only high tech areas where America is ahead of China. If AI is knee-capped, China would indisputably become the world leader in industrial tech and high tech.

2. China is releasing models as open-weight to commoditize the complements. A ban on 10T models would let them specialize and utilize the lower parameter models to extend their lead in areas like robotics.

And once the US & China signed on I'm sure Europe and the middle powers would quickly agree.

▲MiroslavPokorny 4 hours ago | parent | next [-]

The US cant even stop Iran or RU oil exports, stop pretending the US is a global world power.

▲ozlikethewizard 17 hours ago | parent | prev [-]

Vastly overestimating the political capital the US has left to spend after the past decade+. Your closest neighbour is choosing to cosy up with the Reds over dealing with anymore shenanigans.

▲bryanlarsen 17 hours ago | parent | next [-]

The US shouldn't need to spend political capital to achieve something that the other party actually wants.

OTOH, the US also has a massive credibility problem. Nobody's going to sign anything without solid mechanisms to ensure the US won't ignore or tear up the agreement in the near future.

▲fakedang 5 hours ago | parent [-]

Well for starters, the US will need to rip up the CLOUD Act, get on its knees to win back Western goodwill and restart resource extraction and onshore manufacturing. Oh, and restart research spending across all domains.

On the other hand, China could just replicate GPU technology or adapt its models to its own chips (already happened), and then push that onto the rest of the world for cheap. Of late, they too have been very aggressively building out their data centers in Europe and the Middle East. China also controls the resource chain for most essential minerals (thanks to decades of US offshoring).

▲achierius 4 hours ago | parent [-]

Already happened? Where's the Huawei B100 equivalent? Why are the latest Chinese models trained on Nvidia hardware and not Ascends?

▲bostik 3 hours ago | parent | next [-]

A recent episode of Odd Lots had a segment about this question. Their guest, a senior analyst who has been tracking the GPU hardware space (+ politics around it) for years had quite revealing observations.

Huawei's hardware is apparently good enough for inference and the CCP are actively promoting their domestic AI gear ... among other things by banning high-end chip imports. The export bans from the US and import bans from China both have same technical targets but different political goals. The analyst commented that Huawei's gear is not yet good enough for model training.

The situation is going to change once China can - to quote the analyst - "complete a training run on Huawei chips". When that happens, China will start to really crack down on AI chip imports to ensure that their domestic technology is forced to catch up.

▲phatfish 3 hours ago | parent | prev [-]

Surely this won't be a problem with super intelligent LLMs?

▲icepush 5 hours ago | parent | prev | next [-]

The US primarily accomplishes these types of goals with its economic might, not through the expenditure of political capital. And the US still has about 33 trillion of that might in its inventory.

▲cowlevel 3 hours ago | parent | prev [-]

Doesn't need political capital, just needs enforcement mechanisms. Sanctions and bombs.

▲MSFT_Edging 19 hours ago | parent | prev [-]

This is such an interesting part of the whole AI equation.

The main benefit of the closed models is the regulatory control to say, insert guard rails against hacking things. That's also the main drawback as you now have handed control over this technology to a handful of companies, who will reap all the rewards of this captured sector.

It would be like the google/apple duopoly on steroids. Everyone forced to buy in to one of two ecosystems, with limited to no ability to undermine the duopoly via control of the device hardware. One can't make a real competitor because it requires access guarded by existing relationships and money. For the AI houses, it means you need approval from these groups to create in a competitive manner. That, IMO is too much power for an unelected organization to carry.

AI will likely only provide real benefits to humanity if it's open. But if it's open, it will also enable extreme harm in the form of cyber attacks, scams, and destruction of IP.

By keeping AI closed, it will bring a new form of imperialism. Instead of the core maintaining IP and the periphery suffering the secondary effects of industry, the core will maintain the capability and the periphery will be locked out of competition due to silly nation-state rivalries. This won't benefit humanity, it will lock us into the same cycle of misery for marginal gains measured in stock values.

So there's two ways AI can reasonably go: Cyber punk corporate overlords or cyber anarchy due to the inability to put a cork on the genie's bottle.

Both seem terrible to me. What good is space travel without freedom? What good is automation if there are incentives to maintain profit over stability? What good is the technology if any usage of it exposes you to fraud, violence, and blackmail at any moment?

Big fans of LLMs never ask "to what end?", they repeat shallow near term "wows" without considering the second and third order effects. "wow think about how good LLMs can spot cancer in scans!", great! but who will afford the scan without work? Will the overlords commit to luxury gay space communism? Or will they simply say "tough luck" and let that cancer fester?

Real AGI is incompatible with our current power structures, yet those current power structures desire the AGI. This cannot end well. Stagnation and stability would be preferable to the level of misery that would follow.

▲seiferteric 19 hours ago | parent | next [-]

I generally agree, but the main reason I am pro AI (or at least feel it is necessary) is because I do think it will end up helping us solve other problems that I think are existential in themselves like climate change. Maybe it won't happen, but personally I think it will and don't want to go into more detail because some of it will probably seem far fetched but I do think it will happen now. And previously these problems seemed intractable or were only being solved too slowly for us to escape the worst outcomes. So now I think we have this situation where to solve some of our worst problems, we are now creating other problems...

▲MSFT_Edging 18 hours ago | parent | next [-]

AI could solve the planned economy problem and bring about the endless consumption for consumption's sake that's destroying the planet, but there isn't any incentive in it for anyone with a large enough stake in AI.

That's part of the reason why I really appreciate China just throwing a wrench into the closed model system. As long as there's a profit motive for AI, it will only accelerate our current problems.

▲seiferteric 18 hours ago | parent [-]

Well it could, but planned economies are bad because they are not creative, which neither is AI... In fact the entire reason we are having this conversation is because companies doing unrelated things figured out how to do AI and pivoted to it in an unplanned economy, but yes China obviously would like to prevent the US from dominating in AI and it is in their (and perhaps everyone's) interest to release open models.

▲thelastgallon 18 hours ago | parent | prev | next [-]

As it stands right now, AI is massively accelerating climate change, by consuming lots of energy and keeping fossil fuels alive and thriving. AI solving climate change is believing we'll invent new cows that are capable of reverse farting and do methane capture.

There is only one way AI will solve climate change. If it leads to job losses for 80% of the people, so consumption drops to nothing. Nobody drives anywhere, people stop buying things they don't need with money they don't have to impress people they don't like (because EMIs/BNPL need income). If everyone goes down to subsistence level, back to the feudal system, just 100 - 10K billionaires and everyone else low status barely surviving, TFR will drop to under 0.1, delivering the climate change solution.

▲hxtk 18 hours ago | parent [-]

Even if you ignore it impact of AI power consumption, just the opportunity cost is enormous in terms of climate change.

AI is what we’re doing instead of solving climate change. With the money the US has spent on AI in the last few years, you’d have approximately enough to fully remove all fossil fuels from current US electricity generation and replace them with renewables.

Climate change will be solved—if we do it soon—as soon as people start treating it as inevitable no matter how many dollars it costs the same way they do with AI. It will not be solved as long as we keep ignoring the existing, known solutions and hoping that some unrelated technological advancement will just happen to make it cost less to solve climate change.

▲thelastgallon 17 hours ago | parent [-]

Indeed. The trillions of dollars invested so far and the trillions to be invested in the next few years would've been enough to switch the entire world over to solar (batteries, EVs) as well as fund a a few dozen Manhattan scale problems - develop a printable (like fabric/paper) solar, organic solar (so it can be grown like yeast or bacterial growth). So MANY things could've been accomplished ... instead everyone is doubling down on meme stocks.

▲littlexsparkee 18 hours ago | parent | prev [-]

we could stop consuming so much and growing at all cost but no, we are being pitched the (idea|dream) that AI will come up with a technological fix to the problem that allows us to never change our behavior

▲hobo123 16 hours ago | parent [-]

Plenty of low hanging fruit. I'd start with cooling buildings down to 24C in summer instead of 15C (insulation also tends to help). And how about not bagging Every Single Grocery Item in yet another throwaway plastic bag? The US are kind of bizarre in many ways like that.

▲rennie76q an hour ago | parent [-]

Plastic wrapping many items actually reduces the items outputted carbon. If you stop plastic wrapping cucumbers, they last 60% less time on the shelf and you end up having to grow far more cucumbers with all of the carbon emissions that comes with.

Plastic pollution is a different problem in itself but one that often is counter to fixing climate change in the short term.

▲YZF 4 hours ago | parent | prev [-]

I don't know but here's a counter-view. AI right now isn't really smarter than people. It is smarter in some niches but not others. It scales some things by allowing cheaper intelligence to work more broadly. We already have 8.3B of "intelligent units" on this planet. The "intelligence bandwidth" of AI is still a lot less than that. We already experienced increases in "intelligence bandwidth" by increase in number of people, better education etc. The point that I'm making is that an increase in that bandwidth on its own isn't necessarily a problem. If we look at AI "smarter" than us then we don't know but we do know that we have people who are "genius" (e.g. much smarter than the average person) but that on its own doesn't unlock any magic. If AI has an "IQ" of 200 or 300 or 400 we don't really know what that means in how far it can push on any given topic.

Our economy adapts and find equilibrium when things change. We don't need AI to get oppressive societies. We already have those. Does it make it easier to have one? Does it make it harder? I donno. But a lot of this depends on governance and policies. If AI is used for "good" it could mean a better life for everyone. That's not necessarily opposing the interests of AI companies or their owners. What sort of jobs will those people have and how different will those be than the job market today- I donno. Maybe we'll need more software engineers because we'll be building x10,000 the amount of software or maybe we'll be part of a service economy or planting trees. But the economy isn't as simple as "AI can now write code therefore this is the end of software engineering" just like making software engineers a lot more productive (and we have) didn't reduce the number of software engineering jobs. It created more.

In terms of AGI's compatibility with power structures. I don't think there's one answer there. Does it fundamentally change the different forces driving us? If AGI is smarter than us then what does it want? Clearly a lot of what AI offers today is still tied to existing systems. Can spot cancer in scans feels like a good thing. Somebody has to pay for it otherwise why would anyone build it? Like anything else there will be supply and demand and if supply is high and demand low the price will go down. Why should it necessarily drift more towards anarchy or totalitarianism? Why can't it be "free/capitalist + AGI"?