| ▲ | Regulatory Capture by Anthropic Through METR(nitter.cf) |
| 58 points by agnosticmantis 2 hours ago | 24 comments |
| |
|
| ▲ | superchicken099 27 minutes ago | parent | next [-] |
| This guy seems to get off on being a martyr if you read anything else on his profile. Financial ties of this sort are a bad look but the suppositions made based on the findings are speculative until proven otherwise. |
| |
| ▲ | frognumber 11 minutes ago | parent | next [-] | | It is melodramatic, but I don't think "Financial ties of this sort are a bad look but the suppositions made based on the findings are speculative until proven otherwise" is correct. Eight times out of ten, above some scale, money sets incentive structures sets culture. The place the argument becomes a bit speculative is how it does so. This goes through a game of telephone, where the financial incentives for an individual employee (CEO included) may be completely unaligned with the organizational ones. But in my experience, incentive structures set >50% of institutional behavior. | |
| ▲ | stingraycharles 14 minutes ago | parent | prev [-] | | Yeah I can’t take this post seriously. I think the audience of this post is mostly people that are already convinced that the whole AI industry is evil? The tone makes me feel I’m deep in some conspiracy theory blogosphere. | | |
|
|
| ▲ | m3kw9 6 minutes ago | parent | prev | next [-] |
| If LLM's can hack computer system, they can hack political systems. |
|
| ▲ | bbor 16 minutes ago | parent | prev | next [-] |
| I wonder if these people will apologize after the catastrophe. Or even admit to themselves how wrong and harmful they were :( |
| |
| ▲ | crostlybostly a few seconds ago | parent [-] | | I don’t see any world where a high concentration of models in big tech aligned with USG makes the situation better. If a catastrophe is likely, the best things we can have is a bunch of independent models and compute. We need equilibrium and models playing defense against bad actors. The more models and independent compute we have the better. |
|
|
| ▲ | dario_amodei 19 minutes ago | parent | prev | next [-] |
| very well |
| |
| ▲ | m_w_ 11 minutes ago | parent [-] | | I know gimmick accounts aren't really an HN sort of thing, but this one is funny. How was "dario_amodei" untaken until four days ago... |
|
|
| ▲ | droidjj 17 minutes ago | parent | prev | next [-] |
| FYI: When he says, "I have conducted an audit of Anthropic's finances," he means he looked at _publicly available_ information about Anthropic, METR, and a bunch of other orgs. And by the looks of the graph attached to the post, when he says, "I," he means, "Claude." |
|
| ▲ | api 25 minutes ago | parent | prev [-] |
| I think a TL;DR on this whole thing is that Anthropic is controlled by a cult. I heard someone on a group I'm in humorously say it's the first IPO of an apocalyptic doomsday cult. If they truly believed this stuff had a meaningful chance of being an X-risk to humans, they should stop building it and stop pursuing a giant IPO to finance building it. They don't even have the Manhattan project excuse of WWII and the Cold War as a forcing function. There's plenty of biologists, for instance, who have refused to work on things they legitimately think are too dangerous (gain of function research being one, biological weapons another). It's not like people with the expertise to develop and code AI systems can't find other fulfilling interesting work that pays well. But these guys are simultaneously crowing about P(doom) while building the doomsday machine with tremendous enthusiasm. Which means they don't really believe it. I think it's a mix of regulatory capture incentives and a weird cult ideology where the loud part is P(doom) and the quiet part -- the real part, the inner ideology of the cult -- is that humanity's future depends on this cult being at the steering wheel. Their goal is not to stop AI but to make sure the cult and only the cult control it. The seeming indoctrination of the incoming Democrats from the most recent electoral cycle is really troubling. I've wondered if maybe a good way to fight it is to point out that this cult has some problematic views on race/IQ, biological determinism, and has a lot of figures in it with really troubling histories around sex and consent. Search for "Rationalist sex cult" and you'll find endless articles about "Rationalist houses," BDSM orgies that play loose with consent, employees feeling like they're being pressured to participate in certain extracurricular activities, etc. I feel like these allegations pouring out of other circles would be (rightly) a five alarm fire, but for some reason the Rationalist orbit around Anthropic and OpenAI and the whole San Francisco Rationalist cult scene gets a pass. |
| |
| ▲ | meowface 3 minutes ago | parent | next [-] | | I've been a member of the rationalist community since around 2014 (meaning, I am someone who found the SSC blog back then and who comments in their comment section; you don't need to live in California to be a rationalist) and I am thankful there are at least some politicians who recognize there is a serious possibility AI may get really, really powerful really soon and really fast. I feel either people simply do not think AI will ever get that good, let alone get super good very soon, or they think it but are engaging in some sort of magical thinking about the consequences. I can get the former; it is very uncertain how rapidly capabilities might improve. But if you hypothetically take for granted the potential timelines (which one can be totally justified in not doing!), then the rationalists are just obviously completely correct. The rationalists really worried about this stuff do in fact think Anthropic is deeply evil and is close to causing horrible catastrophes. You might not be aware of the schisms that have been created as a result of this. Of course they want them shut down or halted. The more moderate rationalists who are less of doomers basically have similar thoughts on AI as the median Anthropic employee and exec. | |
| ▲ | svara 13 minutes ago | parent | prev | next [-] | | I think a cynical but equally plausible explanation is they do believe it, they think it's inevitable, so might as well make a lot of money in the meantime. The take I'm increasingly coming around to is that, yes, you can use AI to build dangerous systems, but the most dangerous things is that narrative of inevitability. Humans actually have a lot of agency in this, and it will take humans to decide to do something really dangerous with AI. The inevitability narrative conveniently absolves them of any responsibility. | |
| ▲ | hypfer 5 minutes ago | parent | prev | next [-] | | > I heard someone on a group I'm in humorously say it's the first IPO of an apocalyptic doomsday cult. I think most people in power know that, but they also know that we're in for a heavy hitting recession if this stops - and no one wants to be the one "causing" this by speaking up against it too much. Which [put on your tinfoil hats now] might also be why the whole jensen story is how it is, because none of it is "active action". It surely makes people angry, but it doesn't make them angry in a way where they show up at someone's door and go "your decisions are responsible for my economic hardship". It is probably not that and just random chance, but, functionally, it might be a way of letting this crash that doesn't end up with this style of vigilante/lunatic going around. | |
| ▲ | Tarq0n 19 minutes ago | parent | prev | next [-] | | It's more of a muddle of incentives than anything. Using doomsday cult as a model is neither helpful to the debate nor insightful. | | |
| ▲ | api 17 minutes ago | parent [-] | | You can debate whether cult is too strong a word. There is definitely an ideological base, a number of charismatic leaders behind that ideology, and a "scene" around it with its own peculiar set of social norms and jargon. It's a scene with a lot of the kinds of allegations you often find around cults: gross sexual behavior, "problematic" opinions about stuff like race and gender, etc. Is it a cult? It's at least cult-ish. It quacks. Maybe not a duck but it's waterfowl. All I'm really saying is people should look more deeply into this stuff. If they do, I think they'll see what I'm talking about. It is not hard to find. | | |
| |
| ▲ | vkgcr 3 minutes ago | parent | prev | next [-] | | Anthropic Christmas parties sound like they must be wild | |
| ▲ | bbor 14 minutes ago | parent | prev | next [-] | | If they truly believed this stuff had a meaningful chance of being an X-risk to humans, they should stop building it and stop pursuing a giant IPO to finance building it.
Counterpoint: the many long papers and posts discussing why this is a flawed strategy.If you’re going to write multiple paragraphs deriding scientists, you should at least bother to engage with the basics of their findings. Not just spin up bullshit about BDSM orgies and call it a day. | | |
| ▲ | suddenlybananas 11 minutes ago | parent [-] | | Do you have to read every work of theology to be an atheist? | | |
| ▲ | nsagent a few seconds ago | parent [-] | | Certainly not, but if you are not apathetic or a nihilist, then it behooves you to at least read some of them so you can be exposed to the arguments. |
|
| |
| ▲ | sandworm101 15 minutes ago | parent | prev [-] | | Humanity is doomed, but cult members are above humanity. As its de facto parents, those in control will be granted demi-god status by the coming omniscient AI. The IPO is everyone's last best chance to buy into that club before the coming storm. We should all be grateful that they are giving us the opportunity to join so easily. |
|