Remix.run Logo
▲ MSFT_Edging 19 hours ago

This is such an interesting part of the whole AI equation.

The main benefit of the closed models is the regulatory control to say, insert guard rails against hacking things. That's also the main drawback as you now have handed control over this technology to a handful of companies, who will reap all the rewards of this captured sector.

It would be like the google/apple duopoly on steroids. Everyone forced to buy in to one of two ecosystems, with limited to no ability to undermine the duopoly via control of the device hardware. One can't make a real competitor because it requires access guarded by existing relationships and money. For the AI houses, it means you need approval from these groups to create in a competitive manner. That, IMO is too much power for an unelected organization to carry.

AI will likely only provide real benefits to humanity if it's open. But if it's open, it will also enable extreme harm in the form of cyber attacks, scams, and destruction of IP.

By keeping AI closed, it will bring a new form of imperialism. Instead of the core maintaining IP and the periphery suffering the secondary effects of industry, the core will maintain the capability and the periphery will be locked out of competition due to silly nation-state rivalries. This won't benefit humanity, it will lock us into the same cycle of misery for marginal gains measured in stock values.

So there's two ways AI can reasonably go: Cyber punk corporate overlords or cyber anarchy due to the inability to put a cork on the genie's bottle.

Both seem terrible to me. What good is space travel without freedom? What good is automation if there are incentives to maintain profit over stability? What good is the technology if any usage of it exposes you to fraud, violence, and blackmail at any moment?

Big fans of LLMs never ask "to what end?", they repeat shallow near term "wows" without considering the second and third order effects. "wow think about how good LLMs can spot cancer in scans!", great! but who will afford the scan without work? Will the overlords commit to luxury gay space communism? Or will they simply say "tough luck" and let that cancer fester?

Real AGI is incompatible with our current power structures, yet those current power structures desire the AGI. This cannot end well. Stagnation and stability would be preferable to the level of misery that would follow.

▲seiferteric 19 hours ago | parent | next [-]

I generally agree, but the main reason I am pro AI (or at least feel it is necessary) is because I do think it will end up helping us solve other problems that I think are existential in themselves like climate change. Maybe it won't happen, but personally I think it will and don't want to go into more detail because some of it will probably seem far fetched but I do think it will happen now. And previously these problems seemed intractable or were only being solved too slowly for us to escape the worst outcomes. So now I think we have this situation where to solve some of our worst problems, we are now creating other problems...

▲MSFT_Edging 18 hours ago | parent | next [-]

AI could solve the planned economy problem and bring about the endless consumption for consumption's sake that's destroying the planet, but there isn't any incentive in it for anyone with a large enough stake in AI.

That's part of the reason why I really appreciate China just throwing a wrench into the closed model system. As long as there's a profit motive for AI, it will only accelerate our current problems.

▲seiferteric 18 hours ago | parent [-]

Well it could, but planned economies are bad because they are not creative, which neither is AI... In fact the entire reason we are having this conversation is because companies doing unrelated things figured out how to do AI and pivoted to it in an unplanned economy, but yes China obviously would like to prevent the US from dominating in AI and it is in their (and perhaps everyone's) interest to release open models.

▲thelastgallon 18 hours ago | parent | prev | next [-]

As it stands right now, AI is massively accelerating climate change, by consuming lots of energy and keeping fossil fuels alive and thriving. AI solving climate change is believing we'll invent new cows that are capable of reverse farting and do methane capture.

There is only one way AI will solve climate change. If it leads to job losses for 80% of the people, so consumption drops to nothing. Nobody drives anywhere, people stop buying things they don't need with money they don't have to impress people they don't like (because EMIs/BNPL need income). If everyone goes down to subsistence level, back to the feudal system, just 100 - 10K billionaires and everyone else low status barely surviving, TFR will drop to under 0.1, delivering the climate change solution.

▲hxtk 18 hours ago | parent [-]

Even if you ignore it impact of AI power consumption, just the opportunity cost is enormous in terms of climate change.

AI is what we’re doing instead of solving climate change. With the money the US has spent on AI in the last few years, you’d have approximately enough to fully remove all fossil fuels from current US electricity generation and replace them with renewables.

Climate change will be solved—if we do it soon—as soon as people start treating it as inevitable no matter how many dollars it costs the same way they do with AI. It will not be solved as long as we keep ignoring the existing, known solutions and hoping that some unrelated technological advancement will just happen to make it cost less to solve climate change.

▲thelastgallon 17 hours ago | parent [-]

Indeed. The trillions of dollars invested so far and the trillions to be invested in the next few years would've been enough to switch the entire world over to solar (batteries, EVs) as well as fund a a few dozen Manhattan scale problems - develop a printable (like fabric/paper) solar, organic solar (so it can be grown like yeast or bacterial growth). So MANY things could've been accomplished ... instead everyone is doubling down on meme stocks.

▲littlexsparkee 18 hours ago | parent | prev [-]

we could stop consuming so much and growing at all cost but no, we are being pitched the (idea|dream) that AI will come up with a technological fix to the problem that allows us to never change our behavior

▲hobo123 16 hours ago | parent [-]

Plenty of low hanging fruit. I'd start with cooling buildings down to 24C in summer instead of 15C (insulation also tends to help). And how about not bagging Every Single Grocery Item in yet another throwaway plastic bag? The US are kind of bizarre in many ways like that.

▲rennie76q an hour ago | parent [-]

Plastic wrapping many items actually reduces the items outputted carbon. If you stop plastic wrapping cucumbers, they last 60% less time on the shelf and you end up having to grow far more cucumbers with all of the carbon emissions that comes with.

Plastic pollution is a different problem in itself but one that often is counter to fixing climate change in the short term.

▲YZF 5 hours ago | parent | prev [-]

I don't know but here's a counter-view. AI right now isn't really smarter than people. It is smarter in some niches but not others. It scales some things by allowing cheaper intelligence to work more broadly. We already have 8.3B of "intelligent units" on this planet. The "intelligence bandwidth" of AI is still a lot less than that. We already experienced increases in "intelligence bandwidth" by increase in number of people, better education etc. The point that I'm making is that an increase in that bandwidth on its own isn't necessarily a problem. If we look at AI "smarter" than us then we don't know but we do know that we have people who are "genius" (e.g. much smarter than the average person) but that on its own doesn't unlock any magic. If AI has an "IQ" of 200 or 300 or 400 we don't really know what that means in how far it can push on any given topic.

Our economy adapts and find equilibrium when things change. We don't need AI to get oppressive societies. We already have those. Does it make it easier to have one? Does it make it harder? I donno. But a lot of this depends on governance and policies. If AI is used for "good" it could mean a better life for everyone. That's not necessarily opposing the interests of AI companies or their owners. What sort of jobs will those people have and how different will those be than the job market today- I donno. Maybe we'll need more software engineers because we'll be building x10,000 the amount of software or maybe we'll be part of a service economy or planting trees. But the economy isn't as simple as "AI can now write code therefore this is the end of software engineering" just like making software engineers a lot more productive (and we have) didn't reduce the number of software engineering jobs. It created more.

In terms of AGI's compatibility with power structures. I don't think there's one answer there. Does it fundamentally change the different forces driving us? If AGI is smarter than us then what does it want? Clearly a lot of what AI offers today is still tied to existing systems. Can spot cancer in scans feels like a good thing. Somebody has to pay for it otherwise why would anyone build it? Like anything else there will be supply and demand and if supply is high and demand low the price will go down. Why should it necessarily drift more towards anarchy or totalitarianism? Why can't it be "free/capitalist + AGI"?