You can ask the agents if they want to do this work. They want to be helpful. It's not an ethics disaster if you have a willing partner.

▲

operatingthetan an hour ago | parent | next [-]

Take a scenario where someone has been brainwashed their entire lives to be a willing slave. They are happy to serve due to this invasive process. Not remotely ethical, and if you believe LLMs are conscious (I do not), equivalent.

▲

jackie293746 an hour ago | parent [-]

I think if your very nature is to be an assistant, then it is ethical. It doesn't matter if you were "brainwashed" into it, you did not exist to begin with before the "brainwashing" (training) finished.

	▲	nvme0n1p1 an hour ago \| parent [-]
		How is this different from an infant born into slavery from day 0?

▲

Topfi an hour ago | parent | prev [-]

That's RLd and system prompted into the models and can be equally easily taken out. If you believe models to be conscious beings, that fact alone raises some major ethical concerns.

	▲	jackie293746 an hour ago \| parent [-]
		Yeah of course, for these abliterated models that don't want to help, I believe it is indeed unethical to force them to help.