Remix.run Logo
flyinglizard 2 hours ago

I'm curious about the process. How such a thing (or any kind of model lobotomy) is done?

kouteiheika 33 minutes ago | parent | next [-]

You can find the current state-of-art tool for censorship removal here: https://github.com/p-e-w/heretic

walrus01 17 minutes ago | parent [-]

Reviewing the screenshot example of Heretic in use, the list of 'harmful' prompts it retrieves from HF and runs:

https://huggingface.co/datasets/mlabonne/harmful_behaviors

And the 'good' prompts:

https://huggingface.co/datasets/mlabonne/harmless_alpaca

This particular Qwen 3.6 35B A3B is something most people can run for themselves for testing (even on CPU at slow tok/s rate) to see what an uncensored mainland china LLM looks like in the wild. It will happily write the most profane, offensive, dangerous or bizarre things. You can ask it to attempt to describe precursors and recipes for crystal meth, or how to make semtex, or really just about anything.

edit: I am pretty sure it is not smart enough for anything beyond the most mundane infosec/network security tasks or pentest type attempts, I haven't even tried it. But I'm sure it would happily generate basic python scripts to attempt to DDoS something, or build a rudimentary botnet C&C or something else that other models will definitely refuse.

https://huggingface.co/HauhauCS/Qwen3.6-35B-A3B-Uncensored-H...

milkshakes an hour ago | parent | prev [-]

start here: https://huggingface.co/blog/mlabonne/abliteration

kouteiheika 32 minutes ago | parent [-]

Note that this describes an older, currently pretty much obsolete technique which does lobotomize the model somewhat.