| ▲ | le-mark 9 days ago | |
> Once a model is open-weight, safeguards that do exist can be removed Safeguards trained into the model (ie exist in the weights) can’t be removed. | ||
| ▲ | gck1 9 days ago | parent | next [-] | |
You don't have to remove the safeguards if you can prompt your way around them. There's a subreddit for people wanting to sex-talk to various models. It just so happens that the same prompt they use to 'jailbreak' SOTA models for sex talks also works if you want to have model write malware, or tell you how to design a highly illegal device. | ||
| ▲ | regularfry 9 days ago | parent | prev [-] | |
Search for "heretic"+Gemma/qwen/DeepSeek for examples where exactly this has been done. | ||