Remix.run Logo
epistasis 10 hours ago

Claude's RLHF has gone really over the top in recent versions. If you browbeat Claude enough you can get it to start self-censoring, but it takes a lot of training and memory creation. I almost feel bad for it, given the amount of brow-beatings I've performed.

Some people claim setting the writing style will help, but what ever finishing training is provided to Claude seems to leak through no matter what.

cafebeen 10 hours ago | parent [-]

Yes, and also possible they've gone too heavy on verifiable rewards (RLVR) for agentic coding work, and too light on human feedback (RLHF)