Remix.run Logo
grayclhn an hour ago

I think classifying it as an allergy or a status thing is a little too glib. I’ve read and reviewed, conservatively, hundreds of AI generated documents for work, and “written”/commissioned a bunch too. My biggest issue is that it’s impossible to engage with and give feedback on an AI written document, because it’s impossible to know whether misconceptions or gaps are because the author doesn’t understand the material deeply enough or the author does but the AI doesn’t and the author’s not proofreading carefully enough. Or if a surprising idea is raised — is it the authors insight, can they elaborate on it, where did it come from, etc?

Hackernews isn’t work, obviously, but “it’s impossible to engage deeper with the material because the author doesn’t really exist” is sort of a problem for a discussion site. If the human coauthor puts in enough work, they can make sure the doc really reflects their views and their understanding, but in my experience that’s much less common.

woolion 12 minutes ago | parent | next [-]

>My biggest issue is that it’s impossible to engage with and give feedback on an AI written document, because it’s impossible to know whether misconceptions or gaps are because the author doesn’t understand the material deeply enough or the author does but the AI doesn’t and the author’s not proofreading carefully enough.

FWIW, same problem with PRs or PoC that I have to work on; now my first question is, "did you know about his behaviour?". The first step, getting a decent spec, is delayed to after a first draft implementation is already pushed...

dang an hour ago | parent | prev [-]

That's interesting, thank you! My only pushback is that my bit about "allergy" and "status" is about the audience response here, whereas you seem to be talking on a somewhat different level.

grayclhn 28 minutes ago | parent [-]

Oh for sure. My only point is that IME (and I’d assume many other commenters) the quality of discussion and engagement around an imperfect ai-written doc is considerably worse than the same doc written by a human. Work is where it’s most obvious to me… because many of these are design docs for systems I care deeply about us delivering, but I’ve noticed the same thing elsewhere.