Remix.run Logo
3eb7988a1663 4 hours ago

Who is offering the refusal vectors or instructions on how to generate them?

wren6991 4 hours ago | parent | next [-]

Here's a widely used toolkit: https://github.com/p-e-w/heretic

Distributing the vectors themselves isn't (yet) common practice, because people have gotten used to just putting the full modified weights up on HuggingFace's huge free storage.

p-e-w 4 hours ago | parent | prev [-]

I am, in fact, I’m offering something much better, a compact format that exactly restores an abliterated model from a tiny JSON file:

https://www.reddit.com/r/LocalLLaMA/s/iksvmXBzuC