Remix.run Logo
exabrial 9 hours ago

Anyone ever seen the SouthPark episode making fun of Game of Thrones: A Song of Ass and Fire? Anthropic's announcements reminds me of "The Dragons Are Coming" running joke.

What they have done:

* Nerfed Fable, as many of noted it's useless

* Leverage Mythos as a marketing strategy, claiming its too good to release

* Removed thought traces, one of the only useful things to make sure your prompts are working correctly

* Continue tons of hype about how good they are without delivering, going to great lengths to publish how their model "hacked" its way out of a sandbox they misconfigured.

* Push a bunch of EU Overregulation onto the rest of the world with text watermarking, decreasing quality of answers

Last year, they were at least focused on making improvements. Nowadays its just a bunch of handwaving at the church of how good they are.

The only saving grace is Opus 4.6 is still available. Just sucks we haven't seen any measurable improvement, despite all of the ceremony.

flaghacker 9 hours ago | parent | next [-]

Text watermarking has no effect on output quality, it just works by changing the explicit source of randomness that is in practice always present in LLM output sampling. See for example https://www.seangoedecke.com/ai-text-watermarking-is-not-a-b....

pkulak 9 hours ago | parent | next [-]

> Text watermarking has no effect on output quality

It has an effect, and it's negative. It's hoped that the effect is negligible, and it probably is, but the whole point is that it has an effect.

markasoftware 6 hours ago | parent | next [-]

Its essentially swapping out the psuedo random number generated with a differently seeded one iirc.

It has an effect on the output, but not the output quality

reasonableklout 7 hours ago | parent | prev | next [-]

It seems fine to me. The model is still solving my problems and writing code that works as well as any other.

Google has been watermarking text with SynthID for a while now and nobody complained about it. Why all the fuss about Claude?

It feels like the real reason behind most complaints is that people want to use AI for writing and not have others find out?

k1m 3 hours ago | parent | prev | next [-]

It reduces diversity, which they don't talk about much. Wrote about it here. https://blog.keyvan.net/p/ai-text-watermarking-and-quality

geysersam 4 hours ago | parent | prev | next [-]

It has an effect, 50% of the time it's positive, increasing the quality of the answer, and 50% of the time it's negative.

qgin 4 hours ago | parent [-]

These models are already running with a temperature that is >0. This just replaces a random number with a slightly less random number.

NewsaHackO 6 hours ago | parent | prev | next [-]

I am pretty sure they did A/B testing to show it didn't. I could gave sworn they even released a quiz were the user has to try and guess which answer is watermarked or not and it was impossible to tell.

sejje 6 hours ago | parent [-]

That's not the metric, though.

You either output the best version, or you output something else.

You can't do both.

frabcus 6 hours ago | parent | next [-]

That's not the case, because LLMs are non-deterministic.

It only alters outputs when the last layer of the neural network give significant weights to multiple tokens, and it would anyway have picked a random answer.

Instead it picks a non-random one, but non-random in such a way that you can't tell without the private key of the watermarking.

This mostly adds randomness these days for branches in syntax that make no difference, and the model has no reason to believe make a difference. Anything that matters, it is much more confident in the last layer of weights on the token to use.

NewsaHackO 5 hours ago | parent | prev [-]

I feel as though you are overlooking simple statistics/confidence intervals. It absolutely possible for two different works to be not have a distinguishable difference in quality.

sejje 5 hours ago | parent [-]

Agreed, but not if one of them was altered to contain a secret message. That one will have a distinguishable difference in quality. Maybe (almost certainly) negligible, but still there.

joshuamorton 4 hours ago | parent [-]

This...isn't true.

Others have already said this, but the watermarking is something like "when the model flips a coin picking between two values, always choose heads". It was already flipping a coin. You're not choosing a less good result, you're just using a deterministic process when it was stochastic before.

This will have some impact on outputs, but unless you have some reason to believe that always picking tails was better than always picking heads (in which case, you should be working at one of these companies in model training!) it won't have any impact on output quality.

arrrg 7 hours ago | parent | prev [-]

Why do you claim that?

There is no reason why there has to be a negative effect of text watermarking.

pkulak 6 hours ago | parent [-]

It literally re-weights the output tokens from what the LLM would otherwise have chosen. It _has_ to. It can't be positive, because then that's not watermarking, it's a better LLM.

frabcus 6 hours ago | parent | next [-]

It's a very unintuitive algorithm, and is pretty clever.

I recommend reading up on it: https://www.nature.com/articles/s41586-024-08025-4

But no, it only ever picks tokens that are in the probability distribution of the last layer, and it might have picked anyway.

brokencode 3 hours ago | parent | prev | next [-]

Unless you’re at 0 temperature, there is no single token it would have chosen. It’s always picking one of multiple randomly according to a probability distribution.

northzen 7 minutes ago | parent [-]

Give me an example how would you watermark a single short sentence like "I like turtles"?

qgin 4 hours ago | parent | prev [-]

Unless you’re running at temperature 0, there’s not one single token that the model definitely would have chosen each time.

exabrial 8 hours ago | parent | prev [-]

This is hilarious this keeps being repeated by the true believers ad nauseam.

Also, don't apply EU law to the world. It's a knee jerk reactionary regulation by a bunch of aging ding dongs that can't print their emails.

frabcus 6 hours ago | parent [-]

You're on Hacker News - I suggest you have technical curiosity and actually understand this very unusual and innovative algorithm, before you claim things about it that aren't true.

skue 2 hours ago | parent | prev | next [-]

> * Continue tons of hype about how good they are without delivering, going to great lengths to publish how their model "hacked" its way out of a sandbox they misconfigured.

That wasn’t Anthropic. Clearly not a well informed take.

greenowl 9 hours ago | parent | prev | next [-]

Cut them a break. They are trying to IPO soon.

xyzsparetimexyz 9 hours ago | parent [-]

when?

Barbing 8 hours ago | parent [-]

Before OpenAI, before bubble burst, before open-weight Mythos.

lgl 7 hours ago | parent [-]

In AI years that's probably next month or two.

onidj 8 hours ago | parent | prev | next [-]

What do you mean fable is useless?

rplnt 8 hours ago | parent [-]

(not op) It cannot be used to develop applications. Every application needs to be secure in some way, and any such mention in a review triggers Fable's upsell feature.

chillfox 3 hours ago | parent | next [-]

I never actually managed to use fable successfully even once on a pretty standard mvc/microservice app.. It would always find the endpoint permission checks and revert to opus 4.8.

I also had glm 5.3 flash fix an issue that opus 5 could not solve. glm took 4 times as long and a sub-agent tried to cheat (sleep; echo ...), but in the end it actually solved the issue. opus 5 never figured it out.

I think the safeguards might be cooking the anthropic models.

lokelow 7 hours ago | parent | prev | next [-]

Agreed. I was trying to get it to review some auth refactoring in my app recently, and it appeared to find some vulnerabilities. as it was aggregating the results it was flagged and restarted the whole process with Opus 4.8 and all of my usage credits were gone.

Anthropic told me to use their `security-review` tool - as this was the exact scenario the tool is for - and it still got flagged.

ceejayoz 7 hours ago | parent | prev | next [-]

Mythos and Fable are the same cost, aren’t they?

enraged_camel an hour ago | parent [-]

Yes they are.

The OP doesn't appear to know what they are talking about. Fable can absolutely be used to develop applications. It's just that for security stuff I use Opus 5. Which is fine for most use cases.

viccis 6 hours ago | parent | prev [-]

Weird. I'm using it to do a bunch of work on something that manages security rules, with a bunch of sample data with spooky scary fixtures all over with "Mimikatz" and "CobaltStrike Beacon" and "Crowdstrike EDR" type stuff everywhere, including work to harden my system, and I've never been downgraded.

epolanski 8 hours ago | parent | prev | next [-]

While I also agree that Opus 4.6, in some ways, was the last model that truly felt an assistant, all the following ones seem to have inverted the role, even a blind person can see that throwing difficult problems, and complex bugs at this model achieves more than predecessors.

I don't think there's nothing ground breaking, but sure it achieves and finds more, sooner.

llm_nerd 7 hours ago | parent | prev | next [-]

> Nerfed Fable, as many of noted it's useless

I certainly don't take AI advice from HN, but this is amazing.

Useless? Yes, the safeguards are ridiculous and obnoxious, though I can say that 5.1 greatly relaxes them (just doing a hardening of a project parallel with this comment, which 5.0 refused to do...so did Sol and Gemini, fwiw. The Gemini one is a laugh, because 3.1 pretending like it's a dangerous tool is simply ridiculous at this point), however Fable is extraordinarily useful.

It is, far and away, the most powerful programming model, in my experience. Like, crazily so. It absolutely annihilates Opus 4.6, which I mention given the incredibly weird reminiscing people are doing here.

And for that matter it humiliates Opus 5.0 as well. Opus 5 somehow seems like it's neck in neck in the major benchmarks, but there is simply no reality where that is true. Opus stumbles over everything that Fable just blazes through.

tomalbrc 5 hours ago | parent | next [-]

> it humiliates Opus

???

llm_nerd 5 hours ago | parent [-]

It is a vastly superior model for complex, real-world coding tasks. I've constantly had Opus 5 hit road blocks where it spins in circles at xhigh, where switching to Fable immediately solves it. I've had Opus create solutions that Fable then points out the gaps and limitations with, and have never seen the opposite happen.

The fantasy that Opus is superior for coding, much less the incredibly weird clutching onto some far obsolete model, is not reality based.

tripleee 7 hours ago | parent | prev [-]

[flagged]

llm_nerd 7 hours ago | parent [-]

That's, uh, a great contribution. Thanks. It's super important that HN learns how this sounds like to you.

tripleee 7 hours ago | parent [-]

Just doing my part

NooneAtAll3 7 hours ago | parent | prev | next [-]

> as many of noted

please rephrase?

Biganon 5 hours ago | parent [-]

"as many have noted", I suppose.

I'm always baffled at how many people write "of" instead of "have", they don't even sound the same

bschwindHN 5 hours ago | parent [-]

The classic one is "should have" or "should've" to "should of" because when spoken, it really does sound similar. I don't know what the fuck people are learning in English classes these days though, or if they even still have them.

efskap 4 hours ago | parent [-]

They sound exactly the same to me.

Wiktionary gives <should've> as /ˈʃʊdəv/, unstressed <have> as /(h)əv/ and unstressed <of> as /əv/.

jbs789 9 hours ago | parent | prev [-]

and yet we still have people saying the rate of change is increasing

my view is we had a leap over the last fe years and it's tapering off.

this is fine, but for the IPOs

samuelknight 8 hours ago | parent | next [-]

The improvement is compounding just about every way you can look at it. The frontier keeps getting smarter. And at any sub-frontier threshold the cost is dropping dramatically. The amounts of smarts you can fit on hardware is increasing so dramatically that even 6 year old consumer GPUs are increasing in price. The pace of change in LLMs and downstream applications is absolutely ripping compared to 2023 or 2024.

tripleee 8 hours ago | parent | prev [-]

We had a leap because of the introduction and refinement of agents - the rest has been minor

anthonyrstevens 7 hours ago | parent [-]

I've been using the same agent for 15 months. I think this statement is laughably wrong.