Remix.run Logo
madrox 2 hours ago

In five years, I'd love to read a book about the history of AI ethics. I suspect it will read like Voltaire.

My sense is that it is radically shifting from a fluffy marketing arm to a department expected to contribute meaningfully to development and justify its impact. I would expect an ethics team to build frameworks that can help train/eval the model that the company spend millions of dollars and months training is going to be aligned to the ethical stances the company chooses. If they can't, the waste to time and money is huge if the model requires retraining for ethics reasons. That's a different job than pondering roko's basilisk or whether AI is alive.

The people in AI ethics who spent years thinking their job was marketing or publishing thinkpiece papers may be having to adapt quickly or get out of the field.

teiferer 2 hours ago | parent | next [-]

> if the model requires retraining for ethics reasons.

Haha, how refreshingly naive. What do you think is more likely: this or the other way around: getting the "ethics team" to align with investor goals? Hint: Where does the money come from?

> The people in AI ethics who spent years thinking their job was marketing or publishing thinkpiece papers may be having to adapt quickly or get out of the field.

Or it's exactly those people who will be left. We will read about it in your book.

moritzwarhier an hour ago | parent | next [-]

> What do you think is more likely: this or the other way around: getting the "ethics team" to align with investor goals? Hint: Where does the money come from?

From the (ethics) team obviously, because the investors just have goals and aren't a team!

Big irony marker of course. But remarkably, in human history, this line of thinking would not be unheard of. Of course, I don't think it easily adapts to companies of course, so I don't really disagree with you.

Remember that MTV show offering people like 5 grand or something to lick an elevator handway in front of a camera?

Well, if someone has a useful idea in this world, and want to build a company from it, the MTV "lick-the-stairway" offers will be the largest and first hurdle before anything else happens. People will simply offer to buy you out, and that's not limited to founders and creatives.

That's how our system works.

pessimizer 21 minutes ago | parent | prev | next [-]

It's funny, but Scientologists were innovators on this front. They use the word "ethics" a lot, but they've specifically redefined it to mean productivity at work (people who aren't productive are stealing a living.)

Being "downstat" (iirc) is when you're not productive in comparison to your coworkers, which makes you "outethics" and a "potential trouble source (PTS)." If you're outethics, then you get called in for "auditing" which is when they interrogate you with a lie detector to find out if you're associating with "suppressive people (SP)" (who are people who are causing you to be downstat because they despise human happiness.) If those people can't be found, then the problem is obviously in your "withholds" (again, iirc) which are your secret deep-down desires to destroy the organization that you may not even be aware of. You see, your "reactive mind" is raging at being forced to be "ethical." The conclusion is that either you find the SP and "disconnect" from them, you discover the nature of your withhold and admit that you were plotting against the organization and why, or you're the SP and you get declared and ejected from the organization.

Welcome to "ethics." The original AI alignment scholars.

The specific, named people who run these organizations are moral black holes. Anybody that they're hiring for "ethics" they're hiring to define an ethics for their own benefit.

madrox an hour ago | parent | prev [-]

Microsoft Tay has entered the chat.

I'm kind of surprised by the cynicism. There are real problems in AI ethics that contribute to model training. Someone has to own those problems. How that team is incentivized is outside the scope of my comment.

Alive-in-2025 26 minutes ago | parent | prev | next [-]

The goal of an ethics team will be to provide cover for problems created by decisions or suggestions of an llm. They will need to be able to say "We trained it to consider ethical considerations by " <including something like all the reddit and usenet postings ever>. We tested by <some other inadequate strategy that sounds good to lawyers>.

They will use "industry standard practices", they will have tested it somehow, and will be sure to be on the board of some group that is building toothless "ai ethical tests" for llms.

madrox a few seconds ago | parent [-]

I agree, which is a different job from what I expect most AI ethicists imagined it would be.

gizajob 28 minutes ago | parent | prev | next [-]

I think you’re confusing Voltaire with the Marquis de Sade and Machiavelli

madrox 4 minutes ago | parent [-]

I was specifically thinking of Candide

nradov 2 hours ago | parent | prev | next [-]

It's not technically possible to prove model alignment. At best you can establish a probability of alignment within certain constraints.

madrox an hour ago | parent [-]

"Prove" is a shorthand because of course it's a stochastic process. My point is that I would expect ethics to be part of the training and eval criteria.

apercu an hour ago | parent | prev | next [-]

Read “Careless People” or whatever that book by that Facebook employee that pretended not to see how awful all her colleagues were until her priorities shifted is called.

NBJack 2 hours ago | parent | prev | next [-]

I regret to say such a book may end up as a pamphlet. I don't see much going into it.

quickthrowman an hour ago | parent | prev | next [-]

I think AI ethicists will be pushed out entirely after (before?) the money really starts rolling in. Ethical concerns interfere with profit margins.

madrox an hour ago | parent [-]

The ethicists who see their job as publishing papers and acting as philosophy professors, sure, but someone has to own the training and eval suite for how AI thinks about trolley problems.

GolfPopper a few seconds ago | parent | next [-]

Once the AI is working, surely the corporation can just ask it to come up with an inexpensive accountability sink for trolley problems? Perhaps it will suggest hiring an impeccably credntialed AI ethicist to legally opine that it has the most ethical trolley problem solutions?

a2ff6eeb0 36 minutes ago | parent | prev [-]

Why? Are trolley problems making it hard to make money?

madrox 5 minutes ago | parent [-]

Because leaving that to emergent behavior is silly. Why is the idea of training models on ethical reasoning so strange?

a2ff6eeb0 37 minutes ago | parent | prev | next [-]

Hahaha, what an insane take. No, anyone that gets in the way of the money machine is going to have to rapidly get out of the way, or get fired.

Avicebron 29 minutes ago | parent [-]

Bro trust, they will be like Voltaire. The circle doth jerk itself over at lighthaven.

gyanchawdhary an hour ago | parent | prev [-]

They all get Timnit Gebru'd sooner or later .. its a fake role tbh