| ▲ | overgard 4 hours ago |
| So, regardless of whether or not Anthropic CAN create a self improving AI.. does anyone else feel like they shouldn't be allowed to? Or it at least needs to be strictly supervised..? Like, I don't actually think Anthropic can make the singularity any time soon, but I think even AI boosters have to admit doing this is creating a society-wide danger for the benefit of a very very small number of already-rich people. |
|
| ▲ | asdfman123 4 hours ago | parent | next [-] |
| I think that's a valid point. You could very well be right. But we're discussing whether we should close the barn door while the horse is three miles down the road. |
| |
| ▲ | Jtarii 2 hours ago | parent | next [-] | | It's more like if the horse was lazily moving in the general direction of the wide open barn door and we are all sitting around discussing if we should close the door or just gamble that it's just going to lay down on the hay pile. | |
| ▲ | resident423 20 minutes ago | parent | prev | next [-] | | You mean that self improving AI is very far away? I'm not sure how much I believe that now it's solving Erdos problems? | | |
| ▲ | asdfman123 12 minutes ago | parent [-] | | Brother I used to be a skeptic... using it at Google has been incredible. Right now I'm only having to direct to enforce good taste. Write tests, don't write an unnecessary function. It does everything else practically. Presubmit, debugging, commit message generation, commit approval... it's happening. |
| |
| ▲ | overgard 3 hours ago | parent | prev [-] | | Only if you think LLMs are the horse (I don't think they are). If they're not, then we should be building a brick wall in front of that door and hiring a full time security guard to watch it. I realize he's saying it for hype, but if the CEO of the company goes around talking about how scared he is of what they're creating, hey, lets just take Dario at his word and put in some strict regulation. He won't mind if they're really about safety. (they're not) Besides, yes, the knowledge of how to build these systems is out there, but the cost of doing it is staggeringly high (ie you can't run a frontier AI lab in your garage). There's only a limited number of known entities that need to be managed, and you can stop "progress" in its tracks by cutting off the money firehose. | | |
| ▲ | asdfman123 3 hours ago | parent [-] | | Right now the S&P 500 is going wild due to the promise of AI automating everything. Who is the "we" who is going to shut it down? Certainly not the US government. Nor the Chinese government w.r.t. their tech industry. Are you going to start the insurgency? Is there going to be an equivalent one in every developed part of the world? | | |
| ▲ | overgard 3 hours ago | parent [-] | | Look at how many data center projects are getting shut down by grassroots movements, or how the approval rating for AI is like worse than congress and it's geeting booed at commencement speeches. I don't need to start an insurgency, people are already pissed off and the volume is growing. The stock boost is, as most will note, a bubble. It will enrich a lot of bad people and leave average people holding the bag, but its not going to go on forever. | | |
| ▲ | JumpCrisscross an hour ago | parent [-] | | > Look at how many data center projects are getting shut down by grassroots movements Like, two? It looks more like the ladder being pulled after the incumbents got theirs than meaningful pushback. (And datacenters don’t have to be built in America.) |
|
|
|
|
|
| ▲ | alfalfasprout 3 hours ago | parent | prev | next [-] |
| Absolutely! Yes. This rhetoric of inevitability only benefits these AI companies. |
|
| ▲ | Melatonic 4 hours ago | parent | prev | next [-] |
| Skynet is 30 years late! |
| |
|
| ▲ | eieie11 4 hours ago | parent | prev | next [-] |
| Too late for that. In any case firms that get too powerful can be nationalised. |
| |
| ▲ | evenhash 2 hours ago | parent [-] | | In America? Probably a better chance the firm privatizes the government. In fact we seem to be firing government employees and dismantling government institutions as much as possible. |
|
|
| ▲ | lukan 4 hours ago | parent | prev | next [-] |
| "does anyone else feel like they shouldn't be allowed to?" No.
Technical limitations aside, I doubt it could be contained, but will be leaked soon, so won't profit just a small number of ultra rich. |
| |
| ▲ | sunaurus 3 hours ago | parent | next [-] | | I dunno, I find it extremely unbelievable that we will get self-improving AGI which chooses to become a slave to humanity at all, ultra rich or otherwise. | |
| ▲ | overgard 3 hours ago | parent | prev [-] | | Step 1: Wait for scary doomsday AI to be leaked, Step 2: ???, Step 3: Profit!! |
|
|
| ▲ | huqedato 4 hours ago | parent | prev [-] |
| Self improving AI is pure dystopia. Anthropic won't build the singularity, AI itself will build it through self-iterations. Read Yudkowsky's book "If Anyone Builds It, Everyone Dies". |
