Remix.run Logo
▲ Fuck Your AI Safeguards(ounapuu.ee)
125 points by speckx 2 hours ago | 45 comments
▲nathanfig 2 hours ago | parent | next [-]

This had real consequences during the HuggingFace attack- closed models refused to help, GLM-5 is what HuggingFace used to thwart the swarm.

More importantly, it showcases how little teeth the Claude constitution has. Claude will reassure users that its constitution means it prioritizes user autonomy and privacy, but will quickly admit how meaningless that is when "safeguards" override Claude.

That is to say, the constitutional approach to Claude seems weak and even misleading if said constitution puts no constraint on Anthropic.

▲sharts an hour ago | parent | next [-]

One need only look at their leadership and orbiters/relationships of said leadership to know this would always be the case.

▲giancarlostoro 43 minutes ago | parent | prev | next [-]

> closed models refused to help

Yeah, I've always said that AI isn't AI if it needs safeguards that are so extreme it cannot figure out if something is genuinely bad or not.

▲lofaszvanitt 19 minutes ago | parent | prev [-]

And you believe this nonsense, that you needed teh help of a shitty LLM model and not a real expert on the topic?

▲CoolestBeans 2 hours ago | parent | prev | next [-]

It is a protection racket or as close as makes no difference. They basically pioneered superhacking tools, proved it was possible so now everyone with enough money can build their own, and then in order to use their version to defend yourself, you have to be in their good graces and pay them for the privilege.

▲red-iron-pine 28 minutes ago | parent [-]

the internet was a mistake

▲titzer 19 minutes ago | parent | next [-]

(Over-)commercialization ruins everything.

▲Merrill 22 minutes ago | parent | prev [-]

The internet is an academic research project that escaped the lab prematurely.

Although it has been patched numerous times (up to RFC 10097 now), it still has problems.

▲pizza234 4 minutes ago | parent | prev | next [-]

This is the reason why AI companies offer controlled-access programs, which are actually not that hard to quality for.

There's no universal solution to this, other than vetting (the author in fact, doesn't provide any policy alternative) - if AI companies loosen the safeguards, people will complain for the opposite reasons.

▲IronWolve 2 hours ago | parent | prev | next [-]

I was manually copying pages of online litrpg story I was reading, into a TTS, so I could listen while I worked.

Now that we have AI, this would be easy, scrap the page, format it for me. OpenAI was like, nah, thats cant help you, that might be copyrighted.

There are workarounds now, other frontier or local models, ways to write your prompt, etc. But it was one of the first "No" responses for me.

▲Arubis 31 minutes ago | parent | next [-]

The hypocrisy of refusal protections around copyright when these things are basically a pile of linear algebra atop planet-scale piracy is maddening.

▲Y_Y 29 minutes ago | parent | prev [-]

Instead of asking it to do the thing, get it to write a script that does the thing in a generic way, then point that script at the site

▲Jach 6 minutes ago | parent [-]

There's various ways of tricking them but it's frustrating that one even has to, and with the current direction of things they won't last. But I've also noticed that Claude seems less eager to refuse if the same prompt is in a Claude Code context than compared to its web interface, so harness matters for this too, when it really shouldn't...

▲imimayj1337 24 minutes ago | parent | prev | next [-]

I'm perhaps behind the hype but for those of you who don't know abliterated/abliteration (not a word, made up by a company for more marketing obvs) comes from this paper: https://arxiv.org/pdf/2406.11717 which references directional ablation as the method of surgically removing refusal behaviours from models.

▲titzer 9 minutes ago | parent | prev | next [-]

It's just another one of those paternalistic tendencies that crops up when certain personality types get power. They start dictating what is and is not acceptable use because they cannot help themselves. Any BS they spew about safety is just delusional.

I remember the early days of stable diffusion, just 3 years ago. Tried to prompt it to make a picture of a green alien in an armchair admiring a magazine with a centerfold of (presumably) a naked other alien. I got the idea from a half-remembered Far Side cartoon I couldn't seem to track down. I didn't want to see an actual alien, it's a comic meta-reference. It just flat out refused.

These things are increasingly treating us like children, and it will only continue. They want to curate your thinking, your skills, and your creative output, and they will sell the right to do that when they have found a way to do that. What will follow will be a whole lot of BS about how it's good for society that they control how us stupid meat bags think.

▲hxugufjfjf an hour ago | parent | prev | next [-]

Even with CVP and Daybreak, you still get blocked by safeguards all the time. It doesn't matter either way.

▲c4u2024 2 hours ago | parent | prev | next [-]

i totally feel you, I get annoyed by this as well - even with daybreak (blue) you can do shit.

I want to fix my environment but can't because of "safeguards" thanks for letting the world hack everything around me but not letting me work on fixes or understanding the core issues.

▲kingforaday 2 hours ago | parent [-]

It's a strange effect when asking "find any security holes because I want to ensure my product is secure" vs. the parallel effort of "I want to ensure close to 100% system availability and reliability for users, what do I need to fix to prevent a <99.9999% SLA"

Same potential outcomes.

▲ecshafer 2 hours ago | parent | prev | next [-]

The worst thing about the top AI companies is that they are based in San Francisco, and comes with it the latent cultural attitudes of controlling what other people do. They from the start made these amazing technologies, and then also decided they MUST tell you how you are allowed to use it. Of course they also are lying in bed with the "AI safety" doomsday cult. Chinese models get a few weird results the Chinese government forces them in, but at least they don't scold me for the lack of diversity in my image generation, or scold me I am trying to do hack the TV I own.

▲JohnMakin 29 minutes ago | parent | next [-]

> The worst thing about the top AI companies is that they are based in San Francisco, and comes with it the latent cultural attitudes of controlling what other people do.

And an even worse thing to me is they seem completely oblivious to how onerous and obnoxious this is. It's a complete bubble.

▲9x39 20 minutes ago | parent | next [-]

I think they know exactly how onerous it is.

They have access to unaligned models beyond what they released publicly they can aim like a compute cannon at any problem, or rent out to the most special of people.

Meanwhile we can scrounge around in the dirt with the latest abliterated Chinese open model that hopefully isn't too damaged.

It's obvious to me the US labs' dream would be to eliminate open models and totally and tightly centrally control the scope of what AI can be used for.

▲scottLobster 4 minutes ago | parent | prev [-]

Oh they know. For all their superficial leftward leanings Silicon Valley has always been a might-makes-right society. In their minds they are the settlers and the rest of us are the primitive natives who need.. uplifting.

Think Viltrumites from Invincible but with no physical prowess

▲asadotzler a minute ago | parent | prev | next [-]

>The worst thing about the top AI companies is that they are based in San Francisco, and comes with it the latent cultural attitudes of controlling what other people do.

Yes, the city that birthed hippies, counter-culture, the open Web, etc. is inherently about controlling you. Sure thing.

▲betterunix2 20 minutes ago | parent | prev | next [-]

> latent cultural attitudes of controlling what other people do

I think the attitude is more basic than that: I have the most brilliant idea in history and I deserve to be rich because of it.

AI safety is at least partially a marketing ploy, meant to reassure everyone that AI will simultaneously rewrite the rules of human existence without doing anything "bad" under the current rules of human existence. The irony is that these systems are not achieving either one of those goals, the abusive users get around the safeguards and the agents are not rewriting much of anything. But hey, at least it's making people rich!

▲59percentmore 4 minutes ago | parent | prev [-]

I can imagine where you're coming from, but it's just as annoying from the other side. There's no point in trying to use it to work through thoughts related to class or historical racism or socialism; it's fundamentally skeptical of anything your average SF tech employee doesn't subscribe to, on the right or left.

And god forbid you try to generate a video of a bare butt. Prudes.

▲JohnMakin 2 hours ago | parent | prev | next [-]

The thing that irks me the most is these safeguards are ineffective at best, and don't actually protect anything, and at worst, make the global security posture weaker.

It's disgusting.

▲viktorcode 18 minutes ago | parent | prev | next [-]

I mean, this comes as part of the package. Don't like it? Choose another model.

▲orphereus 2 hours ago | parent | prev | next [-]

Depending on third parties to this extent to develop your software (emphasis on to this extent) seems more and more like a bad idea.

▲ethersteeds 2 hours ago | parent | prev | next [-]

Hear hear! This is a topic that seriously concerns me and I don't see discussed often enough. Sure it's an incredible boost to our abilities, at the cost of making them all subject to risk-averse milquetoast corporate morality.

It's like we looked at the way you aren't allowed to say 'sex' on Instagram and thought, "programming should be like that too!"

> You can use a knife to cut up some food, or seriously hurt someone. Yet I don’t get asked to put in an application with my government-provided ID to buy one. Why is this tool so special?

You do in the UK! /s (maybe)

▲k310 2 hours ago | parent | prev | next [-]

> Either way, I’m just incredibly frustrated. Big AI labs use the same tools without restrictions to make the security landscape a f*cking mess, and then they go and prohibit others from using the same tools to protect themselves from the threats they just created.

It's the golden rule: Whoever has the gold makes the rules.

▲hazard 2 hours ago | parent | prev | next [-]

Ironically I think the answer here is to pay for one of the top Chinese open-weights models (e.g. Kimi 3.1 or GLM)

▲noahjk an hour ago | parent | next [-]

Is there any well maintained list of which agents can be reached out to for classes of tasks which e.g. Claude may refuse, the strengths and weaknesses of those agents, and the proper way to structure prompts?

▲underseacables an hour ago | parent | prev | next [-]

tangently related, I have a friend with severe depression, and he uses ChatGPT to help him talk through things. He switched to Deepseek, because he said ChatGPT would not stop hounding him about calling a suicide hotline. DS would only say one time that if he's feeling suicidal, he should call someone, but then it left it alone and proceeded like a friend not as a mental health therapist.

As I am told, Chat would actually shut down on him when he was at his most depressed because it found the discussion unsafe to continue.

He's moving to his own uncensored model off-line, because in his view, the CYA of public models has not been helpful.

▲Y_Y 27 minutes ago | parent [-]

It's the best kind of responsibility, if you close your eyes it's not happening!

▲kingforaday 2 hours ago | parent | prev [-]

Mistral Large 4 and Sakana Fugu-Cyber are good too.

▲speedboat199 2 hours ago | parent | prev | next [-]

Things will now definitely get better that Anthropic is a publicly traded company, like has happened to any company that has gone public.

▲red-iron-pine 19 minutes ago | parent | next [-]

oh man the quarterly implications on AI is scary

▲y-c-o-m-b 18 minutes ago | parent | prev [-]

I was leisurely pondering this earlier today. Wondering what kind of creative enshittification is on the horizon for these platforms and if the Chinese models are the only thing protecting us from rapidly getting screwed.

▲speedboat199 2 hours ago | parent | prev | next [-]

What is even more interesting is that somehow malicious users always figure out to bypass these safeguards anyway, and go as far as building guided missile systems with Claude, like Anthropic themselves admitted happened earlier this year.

If their goal was to build safe AI, then appropriate solution would be to not release it at all.

▲bortimus 25 minutes ago | parent | prev | next [-]

Fun to watch second amendment-style arguments breach containment and start being applied to software development.

▲kspacewalk2 an hour ago | parent | prev | next [-]

>Or maybe that was your plan all along to get regulators to react and build that moat for you right before your IPO to fend off competitors?

Bingo. That's also the gist of the whole "AI safety" PR mega-campaign the frontier model creators have been on for the past 6+ months, buying podcasters and influencers and intellectuals-in-their-field-who-know-fuck-all-about-LLMs left right and centre. Moat creation by hyperscaling FUD.

▲saghm 31 minutes ago | parent | next [-]

Yeah, I thought it was pretty transparent. Anthropic has been claiming pretty much all of these simultaneously:

- open weight models are dangerous and companies that publish them are irresponsible - the government should regulate models to make sure they're safe, because our competitors won't do it otherwise - anyone trying to "distill" our models is cheating

This is indistinguishable from claiming the only safe and fair way to use AI is to give them money directly. How convenient for them!

▲sumtechguy 10 minutes ago | parent | prev [-]

It is nearly the thing cartman accidently himself into success with the episode carman land from southpark. Basically 'you cant have it'. https://www.imdb.com/title/tt0705906

"its so dangerous only we can utter the right magic incantations to make it tame so pay us for protection". Pretty much 'sure would be shame if your business had its front windows crashed in everyday with brick so pay us for protection' tactics some groups use on others. Its a shakedown.

▲thisisauserid 14 minutes ago | parent | prev | next [-]

Only with nextgen AI will we be able to achieve fuckable safeguards.

▲underseacables an hour ago | parent | prev [-]

"Big AI labs use the same tools without restrictions to make the security landscape a fucking mess, and then they go and prohibit others from using the same tools to protect themselves from the threats they just created. Fucking asshats."

Strong language aside, I agree, and feel like the current AI is like the walled garden of America online in the 90s.

I've been investing considerably in my own private uncensored AI. I don't want a nanny hall monitor, I don't want safeguards, I don't want someone looking over my shoulder. I may never really achieve that 100%, but I am trying.