Remix.run Logo
vlovich123 21 hours ago

It’s worse. If the data was separable in this way, you would equally be able to train an AI to mask those signs.

ben_w 20 hours ago | parent [-]

IIRC, the big names in LLMs have no real interest in cloaking the LLM-nature of the text, Google adds deliberate watermarks to text, OpenAI developed a watermark for text but reportedly arent't actually using it.

vlovich123 20 hours ago | parent [-]

Considering [1], I’m going to challenge that their techniques are currently even mildly effective. Given the absolute academic malpractice these papers are pushing, I’m calling BS; while they want to watermark it, they clearly aren’t actually able to. For images. Which are drastically easier than text.

Their interest is irrelevant in the face of technical impossibility. And that’s before you get into other people who don’t care and will just build adversarial tools to bypass the attempted watermarks. It’s a losing useless battle. Google and OpenAI engage in it to try to catch competitors when there’s a lawsuit or to try to clean their datasets clean.

But it’s absolutely unusable for something like “did someone cheat”.

[1] https://hackerfactor.com/blog/index.php?/categories/1-Image-...

ben_w 18 hours ago | parent [-]

> Their interest is irrelevant in the face of technical impossibility.

I'm responding to "If the data was separable in this way, you would equally be able to train an AI to mask those signs.": yes, if you wanted to you could, the big names clearly don't consider masking to be a priority.

> But it’s absolutely unusable for something like “did someone cheat”.

This is the one case where I'd most expect it to succeed:

I suspect most of the people who do want to cloak-to-cheat, don't have the skills to do so; I also suspect most of them are so unaware of what they don't know that they won't even ask an LLM to write cloaking software for them.

vlovich123 6 hours ago | parent [-]

You’re overthinking it. There will be end products specifically for this and they’ll be trained by their peers / the company.