Remix.run Logo
▲ Tell HN: A flood of reports of Opus 5.5 being nerfed
22 points by b--l 20 hours ago | 13 comments

Here are several user reports of Opus 5.5 being nerfed:

https://www.reddit.com/r/ClaudeCode/comments/1xr4urz/opus_55_in_the_past_two_weeks/

https://www.reddit.com/r/ClaudeCode/comments/1xr9x5y/the_nerf_is_real_thank_you_uwum1ha1nho/

https://www.reddit.com/r/ClaudeCode/comments/1xqvqip/anthropic_should_offer_a_free_reset_and_restore/

https://www.reddit.com/r/ClaudeCode/comments/1xr0nz5/either_a_lawsuit_an_apology_or_never_touching/

https://www.reddit.com/r/ClaudeCode/comments/1xl72og/opus_56_imminently_about_to_release/

https://www.reddit.com/r/ClaudeCode/comments/1xqtslm/rant_anthropic_stop_silently_degrading_models/

https://www.reddit.com/r/ClaudeCode/comments/1xr8jod/opus_high_55_nerfed/

https://www.reddit.com/r/ClaudeCode/comments/1xqujuh/opus_55_started_coming_up_with_unintelligible/

https://www.reddit.com/r/ClaudeCode/comments/1xqfp7m/opus_55_xhigh_just_deleted_all_my_apps_data/

https://www.reddit.com/r/ClaudeCode/comments/1xr488d/weve_been_nerfed/

https://www.reddit.com/r/ClaudeCode/comments/1xr6r3t/has_claude_been_made_dumber_again/

https://www.reddit.com/r/ClaudeCode/comments/1xr8aic/fable_opus_55_noticeable_performance_regression/

https://www.reddit.com/r/ClaudeCode/comments/1xrc97q/claude_again_ignoring_all_hooks_first_time_since/

https://www.reddit.com/r/ClaudeCode/comments/1xphsj9/opus_55_is_trying_to_destroy_my_codebase_recently/

These are all within the last week.

I have noticed the same thing myself. I am going to pause Opus 5.5 use. I find it really scummy business practice. We trust them that what is behind the string "opus-5-5" is consistent and what we signed up for. Of course behind the scenes they can do whatever they like and serve whatever model they like under that string. It is a scummy and deceptive business practice though.

▲gorgmah 8 hours ago | parent | next [-]

Polymarket says 80% chance of fable 5.2 release over the next 8 days, it feels pretty consistent to me with other release periods, where the existing models feel "dumbed down".

funnily livenerf is showing the model to be slightly more intelligent these days: https://github.com/ninjahawk/livenerf

Livenerf is also using a subscription to run, not API, so it's apparently not a subscription thing. Maybe if you're unlucky you're served with a quantized model until they release fable 5.2 ?

▲Traubenfuchs 6 hours ago | parent [-]

You have to assume they detect benchmarking / testing and feed those clients consistent models.

▲cedws 13 hours ago | parent | prev | next [-]

I doubt Anthropic are quantizing their own models. Since effort levels are essentially a compute budget I wonder if they’re using this behind the scenes to dial it down when getting close to capacity. Thinking blocks are hidden so we wouldn’t be able to tell right?

From Anthropic's POV it would be better to sneakily nerf the effort level and have some people whine on reddit, than hit capacity and have potentially thousands of customers unable to use the service they're paying for.

▲faangguyindia 17 hours ago | parent | prev | next [-]

It seems like pre-IPO companies need to balance "cost" vs. "optics" and it's one of the metrics they optimize.

So, launch at an "exceptional" state and then cut costs after some time following the release, then repeat to make it appear like lots of advancement is happening.

▲richstokes 16 hours ago | parent [-]

I have zero evidence. But anecdotally (and working with Claude every day) I see wild swings in Opus/Fables abilities day to day. It really does feel like they are twiddling knobs behind the scenes and hoping no one notices.

▲kasey_junk 16 hours ago | parent | prev | next [-]

> We trust them that what is behind the string "opus-5-5" is consistent and what we signed up for.

Do you run evals as a matter of course? Everyone I know that does shows high levels of variance across them under the best case.

That’s not to say that the labs don’t downgrade models at times, just that without any measurement it’s a non-interesting assertion.

▲turtleyacht 19 hours ago | parent | prev | next [-]

Why not use a distributed benchmark? Tokens are shared across volunteers; everyone gets informed of the nerf simultaneously. No one need be surprised.

▲petterroea 10 hours ago | parent | prev | next [-]

I guess a new model release is right around the corner

▲Bender 19 hours ago | parent | prev | next [-]

For me Claude was nerfed when:

- They put the shock collar on it [Cyber] Your session has been paused - meaning I have to start a new session. That is also on Opus 4.8 now, just not quite as sensitive as on 5.5. (Defensive coding, defensive system configuration) In my opinion Claude is not permitted to write secure code or analyze ones existing code for bugs that may be security related. Instead of the shock collar, just report anything illegal I ask Claude to do to Palantir and other related platforms like everyone else does.

- They downgraded my 20x account to a 10x, so I downgraded it to the lowest one. I would have paid for Mythos if they would have permitted me to verify myself.

- I keep hitting context memory limits and Claude starts acting like it has dementia, accusing me of doing things that it did. Claude is not proactively compacting when it should, especially on max. It says max does not matter but in my experience it very much does.

I have not logged in for a couple weeks so I have no idea if the model itself has been nerfed. The feeling I got is that they want to focus on enterprise customers and would prefer individuals went away so I cleared out my data and moved my projects elsewhere that does not block me for wanting to secure my code. Perhaps that is their way of sending more individuals away? Their message has been received loud and clear.

▲jasomill 5 hours ago | parent [-]

Claude's security restrictions seem more like a CYA move than anything related to security. In particular, restrictions on analyzing artifacts uploaded or supplied by public or legitimate authenticated access to erxternal sites seem counterproductive as far as security is concerned.

I find the verification requirements particularly puzzling: low level requirements that amount to "use competing LLMs to spam reports to build cred", high level requirements that preclude detailed analysis of anything that flys below the radar of large actors.

▲echion 15 hours ago | parent | prev | next [-]

I've noticed this too, since about Wednesday.

▲oleksg 17 hours ago | parent | prev | next [-]

Oh man, can't wait for open-source to catch up...

▲gigatexal 19 hours ago | parent | prev [-]

I noticed the same at work using Opus 5.5 on medium which was the sweet spot. It’s now just not great.