| ▲ | ivorius 10 hours ago |
| > - Negative: Submitters just add stylistic markers to make their accounts and output seem human-generated. This is like syntactic sugar: the core content and the size of contributions stay the same, but the style gets quirkier. From my experience reviewing, most contributors never read the policies, especially those making a "quick AI PR". I don't expect the new policy to change this much. > Positive: Submitters actually provide to-the-point, no-bullshit commits and comments That would be a dream. |
|
| ▲ | QuantumNomad_ 9 hours ago | parent | next [-] |
| > From my experience reviewing, most contributors never read the policies, especially those making a "quick AI PR". I don't expect the new policy to change this much. True. At least with a policy about it, the project maintainers can unilaterally close such PRs without further internal or external discussion on any case-by-case basis. |
| |
| ▲ | maybewhenthesun 7 hours ago | parent [-] | | Dingdingding, we have a winner. The main use of such a policy is to be able to just close those giant wall-of-text PRs and have something to point to when people start to scream it's not fair. | | |
| ▲ | tayo42 4 hours ago | parent | next [-] | | Why is a policy necessary. you were never entitled to have your pr merged in the first place? If pr wasn't reviewable pre AI I'd expect it to be closed or ignored too | | |
| ▲ | the_hoser 4 hours ago | parent [-] | | The policy isn't necessary to close the PR. The policy just helps to shut down the ensuing discussion after closing the PR. It helps in quickly dealing with well-meaning onlookers asking for clarification when you block PRs from the account. | | |
| |
| ▲ | mcphage 6 hours ago | parent | prev [-] | | > when people start to scream it's not fair Or LLMs, as we have seen. | | |
| ▲ | chrisjj 6 hours ago | parent [-] | | Or, who knows, the "AI" might gain sufficient intelligence to read the policy... | | |
| ▲ | julianlam 5 hours ago | parent [-] | | Then we'll amend the policy to instruct LLMs to author PRs as Fred Flintstone, yabba dabba doo! |
|
|
|
|
|
| ▲ | stronglikedan 2 hours ago | parent | prev | next [-] |
| > That would be a dream. We just recently started that policy so we'll see how it goes. If anything, having it stated as policy lets us filter out these requests without spending brain tokens on them. |
|
| ▲ | whateverboat 8 hours ago | parent | prev | next [-] |
| But now with AI, this should be "easier" for some definition of easy. In the sense that in the past, this might have taken 15 minutes to write, now with AI, this can take 5 minutes to write by first getting AI to produce a summary and then using human judgement to make it better. So, it's a good idea now to actually demand the dream. |
| |
| ▲ | ivorius 8 hours ago | parent [-] | | If people knew how to get AI to write terse, focused summaries, sure, that might help. I haven't seen many that do (well, ignoring the toupee fallacy). Though the most important aspect is that we need to know the motivation and thought process, and all AI can do is fabricate a 'plausible' one. | | |
| ▲ | adalacelove 7 hours ago | parent | next [-] | | Reading AI PRs reminds me of Monty Python's holy grenade: "And the Lord spake, saying, ''First shalt thou take out the Holy Pin. Then shalt thou count to three, no more, no less. Three shall be the number thou shalt count, and the number of the counting shall be three. Four shalt thou not count, neither count thou two, excepting that thou then proceed to three. Five is right out. Once the number three, being the third number, be reached, then lobbest thou thy Holy Hand Grenade of Antioch towards thy foe, who, being naughty in My sight, shall snuff it.' | | |
| ▲ | dsign 6 hours ago | parent [-] | | I wouldn't mind reading that and having a good chuckle while processing an MR, as long as the comment had been crafted by a person. But now I think writing in grunts is gonna become the thing. "pete? you good boy? we won't hire you/ paper you gave HR girl with older gigs? remember it pete my boy? too many words/ words were too long/ dots you used dots/ you scratched long dash with knife, but baby saw scratch/we don't ai pete/ask if they have job in next cave/good luck." |
| |
| ▲ | lokar 3 hours ago | parent | prev | next [-] | | I have spent many years reviewing and editing design and product documentation from more Jr engineers and product managers. It was a constant struggle to get them to be concise, one I mostly lost. | |
| ▲ | chrisjj 6 hours ago | parent | prev | next [-] | | > If people knew how to get AI to write terse, focused summaries... ... then flooded maintainers would be doing it. | |
| ▲ | ray_kay777 6 hours ago | parent | prev [-] | | I've found that the instructions "be extremely concise" gets me much closer to output that's actually sensible/helpful rather than another wall of text. |
|
|
|
| ▲ | snarfy 6 hours ago | parent | prev | next [-] |
| They could allow AI PRs, but then have another AI PR reviewer reject them if they do not match the definitions for `to-the-point` `no-bullshit` commits. |
| |
| ▲ | skeeter2020 3 hours ago | parent | next [-] | | Please provide 3 examples where layering on MORE of the offending technology has solved the problem. Spam? Malware & Viruses? Customer Service? Hiring & Recruitment? | |
| ▲ | mort96 6 hours ago | parent | prev [-] | | And who pays for the (likely significant, and controllable by everyone) tokens such a system would use? | | |
| ▲ | julianlam 5 hours ago | parent [-] | | A small 4-9B model would be able to run cheaply for this sort of work. | | |
|
|
|
| ▲ | DonsDiscountGas 2 hours ago | parent | prev | next [-] |
| I've always instructed Claude to check the policies first, frankly I'm surprised it's not smart enough to do that already. Would be easy to add to a system prompt. But usually it doesn't matter because many projects have no policies, or maybe they exist but only in hidden forum posts issues or something. |
|
| ▲ | watwut 9 hours ago | parent | prev | next [-] |
| > From my experience reviewing, most contributors never read the policies, especially those making a "quick AI PR". I don't expect the new policy to change this much. The policy allows the reviewer to reject it on the "AI" grounds. |
| |
| ▲ | dspillett 8 hours ago | parent [-] | | > allows the reviewer to reject it on the "AI" grounds … but still unfortunately leaves reviewers having to spend time checking submissions and rejecting them. | | |
| ▲ | jon-wood 8 hours ago | parent | next [-] | | At least half the people firing off LLM generated PRs will have left the "Coauthored-by: Claude" line on it allowing automated rejections. | | |
| ▲ | ivorius 8 hours ago | parent [-] | | Unfortunately, only a single PR like this comes to mind. Most AI authors we've seen were identifiable mainly by overly verbose PR descriptions, meaningless code changes and copy-pasting more AI output when questioned. |
| |
| ▲ | fendy3002 8 hours ago | parent | prev [-] | | oh but it'll be very2 helpful and the time spent will be short. It's easy to verify: * new contributor? * more than 10 files affected (higher count are more valid)? * wall of text on description without screenshots, etc? just close the PR as AI, and then the contributor can challenge it if they feel it should not. | | |
| ▲ | HelloNurse 6 hours ago | parent [-] | | A contributor in good faith is going to accept criticism and resubmit an improved change: less files modified, more explanation, more focus, references to actual tickets and discussion with actual developers. |
|
|
|
|
| ▲ | paulddraper 6 hours ago | parent | prev [-] |
| > That would be a dream. “Mission. Fucking. Accomplished.” https://xkcd.com/810/ |
