Remix.run Logo
vrganj 3 hours ago

That's a very limiting view of things. A model, even an open weight one, is never neutral, it is an encoding of a way of viewing the world.

What kind of "alignment" are AI labs optimizing for? Ideological alignment is the full term, self-censored into something more technological-sounding.

Every model has people behind it rating what it should and shouldn't say. Every time you ask a model and trust its answer, you become ever-so-slightly ideologically indoctrinated.

I don't want my model to reflect the views of American oligarchs or Chinese cadres. I want European values of enlightenment and humanitarianism to be the default.

DeathArrow 3 hours ago | parent [-]

>I don't want my model to reflect the views of American oligarchs or Chinese cadres. I want European values of enlightenment and humanitarianism to be the default.

I don't want AI models to reflect any kind of values whatsoever. I have my own views - thank you - and I don't need other throwing their values in my face using AI.

I prefer AI models not being trained ideologically.

wccrawford 2 hours ago | parent | next [-]

Unfortunately, AI models are trained on humans, and so they're getting that whether we like it or not. I'd also prefer it to be neutral, but I don't think it's possible and the second-best option is to have models from multiple regions and balance things out.

vrganj 3 hours ago | parent | prev [-]

There is no unideological. There is no view from nowhere, what you perceive as unideological is precisely the reflection of your own ideology. The "unbiased" is just whatever matches your own bias.

To quote Zizek:

> I already am eating from the trashcan all the time. The name of this trashcan is ideology. The material force of ideology - makes me not see what I'm effectively eating. It's not only our reality which enslaves us. The tragedy of our predicament - when we are within ideology, is that - when we think that we escape it into our dreams - at that point we are within ideology.