| ▲ | ahofmann 10 hours ago | |||||||||||||
"It's still pretty obvious and still much worse than human prose" You have no idea how many false positives and how many false negatives you have in your judgement. It is indeed impossible to differentiate between badly written human text and somewhat good written llm text. | ||||||||||||||
| ▲ | lelanthran 10 hours ago | parent [-] | |||||||||||||
> You have no idea how many false positives and how many false negatives you have in your judgement. The default LLM style is pretty deterministic. "Not X, Not Y. Just Z", etc. There are phrases and cadences which are very rare in human prose (<5%) but unusually common (+95% occurrences in LLM prose). It is not unreasonable to look at content which is 95% LLM tells and conclude that that an LLM authored it. I have noted, IRL, that those people who read very little, and only read when they have to (work docs, etc) are literally unable to tell that a piece of prose sounds like an LLM even when it has about 12 occurrences of "Not X. Just Y" or "Not X, Not Y. Just Z" in as many paragraphs. | ||||||||||||||
| ||||||||||||||