| ▲ | andy_xor_andrew 41 minutes ago | |
The article mentions you can always simply use a smaller, local, un-watermarked LLM to rephrase the original watermarked text. Which is true, sure. But if we're talking about deterministically taking some watermarked LLM output and having a function removeWatermark(text), it won't necessarily be "trivial" to remove, because the watermark function itself need not be public. Only the API that tests for the watermark need be public, right? Anthropic's magic watermark could be, like the article mentions, something like "every 7th semicolon has a N% chance to be a comma where N is the sum of the last X characters mod Y, and every character in the bit range q1...q2 has a Z% chance to..." etc etc etc. And if Anthropic controls those variables, it would be very difficult to determine the rule, even with some pretty advanced analysis (I would assume). And keep in mind, that example rule I mentioned is pretty naive, too. I expect the actual rule would be way more advanced and not so straightforward as "swap every <charX> for a <charY>" | ||
| ▲ | johnjwang 29 minutes ago | parent | next [-] | |
There exist methods to detect what kind of watermarking tool that someone is using, and most of the big tools have specific signatures that you can look for. For Anthropic, it’s highly likely that the watermark is a SynthID type mark similar to the one that Sean is talking about (I actually ran the analysis here https://johnjwang.com/post/2026/08/12/how-claude-watermarkin...). When we get confirmation of whether all models actually are watermarked, I think we’ll be even more confident. Of course it’s always possible that Anthropic has come up with a proprietary scheme, but I think it’s definitely harder to implement. I think the game will be a cat and mouse game similar to LinkedIn and other websites trying to block scrapers: each iteration makes it harder for someone to figure out the watermarking scheme, but likely not impossible | ||
| ▲ | gblargg 5 minutes ago | parent | prev | next [-] | |
If you can submit the text to determine whether it's watermarked, you just have to progressively alter the content more and more until it passes. | ||
| ▲ | cayleyh 38 minutes ago | parent | prev [-] | |
It could be, but common, we all know that Anthropic's watermark is the using "load bearing", "genuine", and "seam" 1000x more in the same paragraph than any human in history. | ||