Remix.run Logo
roenxi 2 days ago

I mean, this is a rather fun article to read but I'm not entirely sure about the thesis.

> AI Safety Is Mostly A Sex Cult.

> I don't think these people should make policy. (1/?)

One of the learnings from things like the whole Epstein saga has been there are a lot of sex cults in the policy making world and, yes, the people making policy generally shouldn't be. But I'm not sure this article actually comes up with a good explanation of why these particular people shouldn't be making policy. People having active sex lives isn't a disqualifying trait. Being in a cult doesn't disqualify people from being in politics. It is routine and expected that fields will have a lot of similar people in them (as I recall the overlap between security researchers and the furry community is unusual too, and that is hardly more important than justifying a passing comment).

It is more routine than the article writer seems to think for all the people in a small field to know each other and get on really well.

MetaWhirledPeas 2 days ago | parent | next [-]

> Being in a cult doesn't disqualify people from being in politics

Let's survey the American voters

ShinyLeftPad 2 days ago | parent [-]

You don't need to survey them because they already voted. US congress is 95%+ religious people

tsimionescu 2 days ago | parent [-]

Religious people, not cultists. How many Scientologists, Falun Gong members, etc are there in Congress?

ShinyLeftPad 21 hours ago | parent | next [-]

What defines a cult then in your opinion if not "a cult that i like"?

tsimionescu 18 hours ago | parent [-]

I don't like most religions, personally. But there is a significant difference between a regular religious community, that has its own shared beliefs but doesn't completely exclude those who don't share them (e.g. by forbidding members to even become friends with people outside the community), or demand the community members completely dedicate a majority of their time to the religion; and a cult, which does do all of these things.

Note that there exist cults within many major religions. There exist for example extremist Catholic groups that would fit the definition of a cult. But that doesn't mean that all Catholics are a cult.

ShinyLeftPad an hour ago | parent [-]

"AI safety" is not a cult by that definition any more than Christianity or Islam. There's some subgroups that are a bit more cultist, and that's the same in Christianity etc

Same with Falun Dafa, have a friend who is a practitioner, it's completely normal to have friends outside of community (tons of his friends are), no one tries to convert anyone, and between his business and other stuff the time he spends on the practice is really not that much

akomtu a day ago | parent | prev [-]

Scientology is an evil cult, while Falun Gong is more like Buddhism. You can't really compare them.

tsimionescu a day ago | parent [-]

Falun Gong is a cult that claims following its tenets can cure any disease, so you don't need doctors (and that high level Falun Gong members are so perfectly healthy that they are hunted by CCP members for their perfect organs). The founder claims to have magical powers, like clairvoyance, levitation, walking through walls, omnipresence, the ability to cure diseases - at least some of which anyone who follows his teachings could reach. Extraterrestrials, higher dimensions, and other such are also part of it. Also, on the evil cult front, Falun Gong is a supporter of right wing extremists in both the USA and Europe.

So no, I don't agree there is much fundamental difference from Scientology.

akomtu 9 hours ago | parent [-]

Oh my, where did you get this from? I happen to know both. The founder of Scientology was a scientist who started with a somewhat decent idea, got popular in the US, but his fame passed quickly. He really craved for that fame, though, so he changed his teaching into some cultist stuff, paired with some sketchy lord and proceeded with demon invocations. His main book is Dianetics, and his followers are very vindictive to those who leave the cult.

Falun Dafa, on the other hand, is more like a Buddhist discipline. You are free to meditate in a park if you feel like it, you are free to go if you don't. There is no organisation, no one will know your name. Its main book is Zhuan Falun, which you could read to make your own opinion, rather than repeating someone's talking points. CCP hunts Falun Gong because its founder refused to become a part of CCP. You can read this story on Wikipedia. The situation is similar to the early days of Christianity when Nero burned christians alive and wanted to eradicate their faith. The irony is that today the Roman Empire has reduced to the city of Vatican which is the temple of Christianity. CCP will fall similarly.

As for organs extraction... well, read about the Sujiatun Concentration Camp. CCP sends there young Falun Gong followers and sells their organs to high rank officials. Demonic creativity. But what did you expect from a communist regime?

delis-thumbs-7e 2 days ago | parent | prev [-]

You do understand what a cult is? There’s a reason why we don’t let the Scientologists run the military no?

roenxi 2 days ago | parent | next [-]

Because they don't get enough votes to control the military. If they put a convincing pitch in for why they should then they can. Being a cult doesn't rule them out.

> You do understand what a cult is?

Pretty much any religion and a few other organisations beside. Basically people who believe something strongly. What do you think a cult is, in the sense the article is using it?

tsimionescu 2 days ago | parent | next [-]

No, a cult is any closed-off fanatical group that is deemed harmful to its members and sometimes to outsiders as well. The group who launched a sarin gas attack in Tokyo's metro, Aum Shinrikyo, was a cult. The Jonestown group was a cult. Scientology is often considered a cult, though this is less widely accepted (especially since Scientology is much larger).

No one considers Catholicism, or Protestantism, or Baptism cults. There may be specific communities that are cults that claim to be parts of these churches, but that doesn't mean that "pretty much any religion is a cult".

rithdmc 2 days ago | parent [-]

> No one calls the Catholic Church "a cult"

> No one considers Catholicism, or Protestantism, or Baptism cults.

Speak for yourself. I was coercively and forcefully added to the Roman Catholic church when I was baptised. Attempts to record myself as removed (the 'Count Me Out' campaign) were met with familial and attempted Church pressure. I was asked to visit the church to discuss the 'impacts of my decision'. I was not recorded as leaving, and the church updated its rules so people in Ireland could no longer request to leave the church.

The ways cults control you can vary, and they don't have to involve threats or violence to be coercive control. Threatening to take away someone's community for a lack of belief is controlling.

kyleee a day ago | parent | next [-]

Sounds like you got off light, try leaving the religion of peace

tsimionescu a day ago | parent | prev [-]

As I said, I'm certain there are specific parts of Catholicism that do exhibit cult-like behaviors. That doesn't mean the Pope is a cult leader in the same way as Reverend Jones was.

rithdmc 19 hours ago | parent | next [-]

This 'specific part of Catholicism' was the papal aligned Roman Catholic Church in Ireland. No unusual interpretations, no sects.

I feel like your comment here is a 'No True Catholic' style fallacy.

tsimionescu 18 hours ago | parent [-]

Are you claiming that for essentially anyone in, say, Dublin, announcing that they are now an atheist would lead to their family cutting all ties to them?

Or are you just saying that family members would generally declare their deep sadness at the news, and seek to convince them that this is a wrong belief and a mistake?

The first one is what leaving a cult is like (e.g. if you leave Scientology, most family and friends will be forced by the cult to cut ties, even if they personally wouldn't want to; even more extreme cults may physically prevent you from leaving the compound or even hurt you for the attempt). The second one is just the normal human experience of having opinions and a lifestyle that is not accepted by your family; the same happens to many people if choosing a career their family doesn't approve of, or leaves a job their family considers excellent, or dates someone the family doesn't like, and many other scenarios that have nothing to do with religion.

rithdmc 17 hours ago | parent [-]

I feel I addressed this in my original post:

> don't have to involve threats or violence to be coercive control. Threatening to take away someone's community for a lack of belief is controlling.

This is also without getting into how many institutions in Ireland were (and many still are) faith based, requiring you to be a member of the church to, for example, attend school.

We can agree or disagree that being shunned from your community and denied opportunity because of a belief is controlling, but it's what led to my belief the Roman Catholic Church is a cult. Though to me a lot of it was simply not being allowed to leave.

int_19h a day ago | parent | prev [-]

He is, though. It's just that this particular cult has been around for so long that it's "traditional", kinda like tobacco and alcohol were not counted as "narcotics" in most jurisdictions.

tsimionescu 18 hours ago | parent | next [-]

No, he's not. Just look at the life of an average Catholic person and the life of an average Scientologist, or better yet, the life of an average Jonestown resident before the suicide, and see the obvious differences. Note also how little the life of an average Catholic differs from that of an average non-religious person in the same country.

I would be completely fine with saying that there do exist cults operating within the Catholic Church. Arguably, monasteries, especially the more isolated ones, are very much cults, with the cloistered lifestyle, complete dedication to the faith, strict authority, and requirement to cut previous ties to join, plus cutting ties if deciding to leave. I'd even agree that the priesthood constitutes somewhat of a cult, for similar reasons.

However, claiming that all of the hundreds of millions of lay Catholic believers are members of a cult is ludicrous.

a day ago | parent | prev [-]
[deleted]
delis-thumbs-7e 2 days ago | parent | prev [-]

[flagged]

roenxi 2 days ago | parent [-]

It also [0] defines a cult as great devotion to a person, idea, object, movement, or work (such as a film or book) or a small group of very devoted supporters or fans. And I put it to you that the article is clearly using the word more in that sense because it is quite difficult to fit the words coercive, insular, or dangerous to the AI safety people. The accusation in the article seems to be that they're too friendly and sexually inclusive. And if you want to communicate with them they appear to be active on Twitter and not shy.

> Well, technically military is run now by maga incel death cult, so yeah I give you that one. I forgot I was discussing on US forum.

Well, we're speaking in English. I was careful to phrase that in a way that applied to what I'm pretty sure is any English-speaking country. Anywhere that votes could put anyone they like in charge of the military for any reason, cult or no cult. It isn't technically relevant - or practically relevant in most cases. It is just a question of whether the cult has the numbers or not.

[0] https://www.merriam-webster.com/dictionary/cult

delis-thumbs-7e 2 days ago | parent | next [-]

Yes word have meanings, often several of them. I chose the one we often use when we say ”death cult”, or ”sex cult” etc. You claim to say you know exactly what meaning the author meant, which either you have to derive from quite careful textual analysis - which you haven’t - or you have to be the author themselves. Personally think having sex is quite fine and dandy, even group sex if that’s your thing. Sex cult indeed sounds a bit ominous. I wonder why furries are never described as cult, although they are indeed very devoted. Britney Spears fan club has very strond devotees who I’m sure have sex with each other (since it is mostly gay men), but never heard of Britney Spears Sex Cult.

I wonder if it just that you try to weasel away from negative publicity by trying to flex the meaning of words to turn the meaning of this bluesky post upside down? In that case I might suggest you to tread carefully. When nothing is true, everything is possible and all that.

Kinrany a day ago | parent [-]

GP isn't claiming to read the author's mind, they're very clearly claiming that one definition matches the author's actual words.

delis-thumbs-7e 6 hours ago | parent [-]

I am aware of that. I am disagreeing in their interpretation and pointing out how convenient it is to define the word cult in the most favourable way possible to the rationalist (or whatever) movement possible. I am therefore inviting either a strong textual interpretation of the bluesky post we are discussing, or proof of their ability in telepathy.

tsimionescu a day ago | parent | prev [-]

No, it doesn't define "a cult" as that. It defines the word "cult" to also mean that, in certain contexts. Specifically, when you say "the cult of Britney Spears" or "the cult of Kim Jong Un", the word "cult" in those contexts has the meaning you quoted.

But when used simply as "a cult", in a context outside of history or anthropology, it's meaning is virtually always meaning 1 from Merriam-Webster - "a group (such as an organization or religious sect) with tenets and practices regarded as coercive, insular, or dangerous". And there is no doubt that, rightly or wrongly, this is what the article author means to accuse Rationality/EA of being.

roenxi 17 hours ago | parent [-]

Or the cult of Eliezer Yudkowsky aka Yud.

> And there is no doubt that, rightly or wrongly, this is what the article author means to accuse Rationality/EA of being.

There is substantial doubt, I don't think the article did accuse them of being any of those things. Obsessed, yes. Poorly reasoned, sure. Coercive and insular I am not seeing, and dangerous is a difficult reading to find. Whats the danger here, we accidentally maintain the status quo of the insufferable 2025? There is a totally unrelated firebombing invoked, I doubt the dude was in the sex cult and the US seems a bit CEOcidal right now. The most specific criticism I spotted is the article writer thinks they may, in a possible edge case where people take them seriously, hinder medical research. Which is not actually a rare policy position if you spend any time talking to people about what needs to happen to speed up medical research.

tsimionescu 16 hours ago | parent [-]

> There is substantial doubt, I don't think the article did accuse them of being any of those things.

The article says:

> Rationalism as a whole is a religious movement. Not everyone takes marching orders. The core people who mostly live together and attend events and especially orgies in Berkeley are a sex cult, and the ones that aren't having any sex are part of the wider movement and are its recruiting funnel.

> This industry frames its regulations in this way because it has, at its core, a millenarian death cult that worships and fears AI as the cause of the end of the world, that feels compelled to create AI, and that at least somewhat wants to destroy AI as a field.

This is quite clearly accusing them of being a cult in the sense of Scientology or Jonestown, not in the sense of Britney Spears lovers.

As for specific nefarious things that it associates this sex cult with:

- being beneficiaries of money that FTX defrauded their customers of

- being an inspiration/breeding ground for more extreme cults, like the murderous Zizians

- inspiring corporate collusion for absurd outcomes

- monopolizing the discussion and real research/influence into AI safety by focusing on their doomsday scenario instead of more concrete short-term issues (say, copyright issues, cybersecurity, bias-induction, institutional degradation in favor of AI decision making)

- extreme alarmism, such as Yudkowsky advocating for nuclear war as an alternative to allowing AI risks

roenxi 2 hours ago | parent [-]

> This is quite clearly accusing them of being a cult in the sense of Scientology or Jonestown, not in the sense of Britney Spears lovers.

If that were true, I believe you would be able to draw support from the text. You've got quotes there clearly identifying that the author thinks they're a cult, but not a cult in the sense of Scientology or Jonestown (which are/were notable for being coercive, insular, or dangerous).

The quotes identify both are cults. Which, yeah, sure they are. There are a lot of cults. This one has some reasonable points, building an intelligence more intelligent than humans is a hitherto unexplored risk for the species. And none of this means all cults are the same. Unless & until this cult does something bad it isn't in the same camp as the worst cults. And delis-thumbs-7e has a post nearby pointing out that the Britany Spears cultists do actually sleep with each other which I thought was an interesting point.

> As for specific nefarious things that it associates this sex cult with:

This is a list of remarkably mild activities for a cult (more like white collar crimes of opportunity and standard political activism, really, if anything) and an allusion to a different cult, aka the Zizians. And if the Yudowsky people end up like the Zizians they will be the worst type of cult - but if that happened someone has to accuse them of something first.

2 days ago | parent | prev | next [-]
[deleted]
2 days ago | parent | prev [-]
[deleted]