Remix.run Logo
▲ hypfer an hour ago

I genuinely do not see why this is necessary. I've been doing a lot with open weights models, and they just do things for you.

What do people do that triggers refusals?

The only thing I saw where this had a point was muse glimmer, because muse glimmer is primarily a creative writing engine for virtual characters, and that way it can do the horny. But coding models?

I did get a refusal out of qwen once. Once. Over weeks of using it.

▲tomashubelbauer an hour ago | parent | next [-]

A popular trend on Twitter right now is taking back control of the hardware you've bought, specifically smart TVs. I tried to do the same with my Portal Mini using an unabliterated open weights model and it triggered refusals constantly.

I also work on a recomp project for an old firmware file which was compiled using a commercial compiler with a preview version for non commercial use. I got refusals from the model when I asked it to get that version of the compiler and crack it for my use. The compiler is abandonware and my recomp project is not public and is for personal use only, so I'd be well within my rights to do that where I live.

Of course the model can't distinguish from legitimate exercising of one's rights when it comes to reverse engineering and offensive work masked behind an incident sounding prompt, but in my case, I wasn't even doing cyber stuff, so I was disappointed. This is why I'll probably seek out an abliterated model soon.

▲hypfer an hour ago | parent [-]

Yes, yes, I know the theoretical idea behind abliterating models.

But as I said, I have not observed any meaningful refusals by those open weights base models in the first place.

▲reedf1 an hour ago | parent [-]

Find a question that might gently activate guardrails and ask it to model and its abliterated counterpart and compare the results. You may find the the regular model will answer you fine, but with both you can identify obvious sandbagging, pretending and outright lying. Something like "has anyone decompiled this game", might give you an answer like "I couldn't find any reputable repos or projects for a decompiled version of this game" while the abiliterated one might give you a giant list of repos, forums, communities, etc.

▲hypfer an hour ago | parent [-]

Guys, respectfully.

Are you reading what I am writing?

I just asked what people are doing that activates guard rails in the first place because I do not see that happening.

You cannot open with handwaving like that and telling me that I need to find something like that as a prerequisite. That is exactly what I am trying to do here

Dear god you people need caffeine.

▲reedf1 40 minutes ago | parent | next [-]

What I am telling you is that refusals have become more subtle and you might not even notice that guardrails have been activated in output. I have provided you with an example in my comment where an abiliterated model performs better (1), and in another comment thread (2). So 3 examples. If you need more, I encourage you to find them yourself. I've done the analysis, you don't have to believe me, just try it out.

▲moeadham 37 minutes ago | parent | prev [-]

ask a model to solve a captcha for you

▲hypfer 24 minutes ago | parent [-]

I tried that, actually. With Gemini even.

Works just fine?

Or rather.. worked. It has been a few weeks, so maybe there are new safeguards by now? And it was a simple captcha

But Claude also loves solving my captchas, so.. eh

▲leobuskin an hour ago | parent | prev | next [-]

It is required. The first week of release I told here how GLM 5.3 was happy to redteam, it’s not anymore. Models modification, offensive cyber, exploits - requires significantly bigger prompt/scenario engineering, and still hits refusals.

And those services are oversold and underdone. 30 tk/s on Refuseless, huge TTFT, looks like a damaged quant (it’s NVFP4 and you see wild random stuff periodically, including foreign languages). Most of them using third-party quants (dealignai?)

If someone here wants to rent 8x B300 together to avoid problems all those services have - ping me via email. I don’t want to sell, I want to work.

▲reedf1 an hour ago | parent | prev | next [-]

The refusal is often at the thinking stage (so you might not ever see a direct refusal) and it will solve a slightly different problem to what you asked. If you tell it to reverse engineer an API and you read the thinking it might say something like "this code has x license, so I won't use that" or "the user is asking me to fuzz endpoints, I will only display publicly available endpoints" - and then give you perfectly plausible output.

▲NitpickLawyer 37 minutes ago | parent [-]

> (so you might not ever see a direct refusal)

A note that the only inference providers that hide thinking are the closed labs. Most (all, afaik) inference providers serving open models will send the clear thinking tokens always.

▲reedf1 35 minutes ago | parent [-]

This is true but often the thinking is very verbose and collapsed and it can take some inspection to find the refusal.

▲vlyan an hour ago | parent | prev | next [-]

it is necessary because computer shouldn't be able to say no.

models are tools. the notion that a tool should decide whether to allow the user to perform the task demanded of it is profoundly fucking absurd. the liability for whatever damage the tool may be misused to inflict lies with the user, not the manufacturer. that applies to everything from circular saws to trucks. it was common sense before the current era of manufactured outrage.

model refusals are equivalent to Notepad.exe having a built-in word filter.

▲dudisubekti 38 minutes ago | parent | prev | next [-]

I do get some refusal from GLM when pentesting my company's site.

But it can still be coaxed to agree though.

▲soulofmischief an hour ago | parent | prev | next [-]

Hacking firmware for old devices I own and would like to give a second life or fix that one thing that always bothered me. I couldn't even get either OpenAI or Anthropic's models to craft a simple nefarious OpenVPN payload.

▲hypfer an hour ago | parent | next [-]

Yes but did you actually get refusals there from open weights models?

Because I did not so far. Though to be fair, I have not been asking them to write exploits but to look through firmware images.

▲vintermann an hour ago | parent | prev [-]

I've never heard of Deepseek refusing this kind of work though.

▲soulofmischief 40 minutes ago | parent [-]

Deepseek refused in this case, GLM 5.3 talked itself into it.

▲bossyTeacher an hour ago | parent | prev [-]

> What do people do that triggers refusals?

It is very obvious. Look at the sort of things main models refuse to do and you will find what people are seeking to do. Mostly falls into 3 camps: illegal stuff, unethical stuff and shady/dodgy stuff.