Remix.run Logo
▲ pugworthy 4 hours ago

There will probably be a time when it's impossible to determine if content came from an LLM or a human. We're currently in the, "It's been 'shopped, I can tell by the pixels" stage.

▲giancarlostoro 3 hours ago | parent | next [-]

I think for the past year anyone determined enough could direct Claude to make the codebase look purely human.

▲Gigachad 3 hours ago | parent | prev | next [-]

I think the idea is to weed out the obvious stuff and have a rule you can point to. When someone opens 20 PRs in a day with an entire novel in the PR description. You can just close them without having to sink effort in to each one. The LLM signs are less in the code itself and the patterns of how the person interacts with the project. A normal contributor might join the IRC, be involved in the project, start on smaller issues and work up. An AI power user just drive by dumps a mountain of content and then leaves.

If a contributor genuinely understands the problem, has tested the code themselves and writes the PR description themselves, it would be indistinguishable from human written code anyway.

▲Rapzid 3 hours ago | parent | prev [-]

I don't believe that time will ever arrive.

Or if it does, it could be hundreds of years in the future.

But maybe it'll be next year? LOL.

As it is, we seem to be developing detection techniques at a good clip and the way current LLM tech works it doesn't seem like there is a path towards avoiding detection... Plus, humans are genuinely very good at self-tuning to detect LLM output.