| ▲ | mjr00 6 hours ago |
| > Leave it to us nerds to try and solve a human problem with a technical solution... Honestly, my view is that this is a technical solution for a cultural problem. Particularly in the last ~10 years, open source has really been pushed into a "corporate dress rehearsal" culture. All communication is expected to be highly professional. Talk to everyone who opens an issue or PR with the respect you would a coworker. Say nothing that might offend anyone anywhere, keep it PG-13. Even Linus had to pull back on his famously virtiolic responses to shitty code in PRs. Being open and inclusive is great, but bad actors have really exploited this. The proper response to an obviously AI-generated slop PR should be "fuck off", closing the PR, and banning them from the repo. But maintainers are uncomfortable with doing this directly since it violates the corporate dress rehearsal kayfabe, so vouch is a roundabout way of accomplishing this. |
|
| ▲ | zbentley 5 hours ago | parent | next [-] |
| What on earth makes you think that denouncing a bot PR with stronger language would deter it? The bot does not and cannot care. If that worked, then there would be an epidemic of phone scammers or email phishers having epiphanies and changing careers when their victims reply with (well deserved) angry screeds. |
| |
| ▲ | mjr00 4 hours ago | parent [-] | | I didn't mean the "fuck off" part to be quite verbatim... this ghostty PR[0] is a good example of how this stuff should be handled. Notably: there's no attempt to review or provide feedback--it's instantly recognized as a slop PR--and it's an instant ban from repo. This is the level of response these PRs deserve. What people shouldn't be doing is treating these as good-faith requests and trying to provide feedback or asking them to refactor, like they're mentoring a junior dev. It'll just fall on deaf ears. [0] https://github.com/ghostty-org/ghostty/pull/10588 | | |
| ▲ | zozbot234 4 hours ago | parent [-] | | Sure, but that pull request is blatantly unreviewable because of how it bundles dozens of entirely unrelated commits together. Just say that and move on: it only takes a one-line comment and it informs potential contributors about what to avoid if any of them is lurking the repo. | | |
| ▲ | jack_pp 4 hours ago | parent | next [-] | | One problem with giving any feedback is that it can automatically be used by an agent to make another PR. | | |
| ▲ | zozbot234 3 hours ago | parent [-] | | If they immediately make another low-quality PR that's when you ban them because they're clearly behaving like a bad actor. But providing even trivial, boilerplate feedback like that is an easy way of drawing a bright line for contributors: you're not going to review contributions that are blatantly low-quality, and that's why they must refrain from trying to post raw AI slop. |
| |
| ▲ | mjr00 3 hours ago | parent | prev [-] | | Sounds like we're largely saying the same thing. Open source maintainers should feel empowered to say "nope, this is slop, not reading, bye" and ban you from the repo, without worrying if that seems unprofessional. | | |
| ▲ | zozbot234 3 hours ago | parent [-] | | If you explicitly say "this is unreviewable junk, kthxbye" there's nothing unprofessional about it. But just blaming "AI slop" runs into the obvious issue that most people may be quite unaware that AI will generate unreviewable junk by default, unless it's being very carefully directed by an expert user. |
|
|
|
|
|
| ▲ | verdverm 5 hours ago | parent | prev | next [-] |
| > Particularly in the last ~10 years ... This is maturation, open source being professional is a good sign for the future |
|
| ▲ | zozbot234 5 hours ago | parent | prev [-] |
| I disagree. The problem with AI slop is not so much that it's from AI, but that it's pretty much always completely unreadable and unmaintainable code. So just tell the contributor that their work is not up to standard, and if they persist they will get banned from contributing further. It's their job to refactor the contribution so that it's as easy as possible to review, and if AI is not up to the task this will obviously require human effort. |
| |
| ▲ | mjr00 5 hours ago | parent | next [-] | | You're giving way too much credit to the people spamming these slop PRs. These are not good faith contributions by people trying to help. They are people trying to get pull requests merged for selfish reasons, whether that's a free shirt or something to put on their resume. Even on the first page of closed ghostty PRs I was able to find some prime slop[0]. It is a huge waste of time for a maintainer to nicely tell people like this they need to refactor. They're not going to listen. edit; and just to be totally clear this isn't an anti-AI statement. You can still make valid, even good PRs with AI. Mitchell just posted about using AI himself recently[1]. This is about AI making it easy for people to spam low-quality slop in what is essentially a DoS attack on maintainers' attention. [0] https://github.com/ghostty-org/ghostty/pull/10588 [1] https://mitchellh.com/writing/my-ai-adoption-journey | | |
| ▲ | zozbot234 5 hours ago | parent [-] | | If you can immediately tell "this is just AI slop" that's all the review and "attention" you need; you can close the PR and append a boilerplate message that tells the contributor what to do if they want to turn this into a productive contribution. Whether they're "good faith contributors trying to help" or not is immaterial if this is their first interaction. If they don't get the point and spam the repo again then sure, treat them as bad actors. | | |
| ▲ | michaelt 4 hours ago | parent [-] | | The thing is, the person will use their AI to respond to your boilerplate. That means you, like John Henry, are competing against a machine at the thing that machine was designed to do. |
|
| |
| ▲ | bpavuk 5 hours ago | parent | prev [-] | | ...and waste valuable time reviewing AI slop? it looks surprisingly plausible, but never integrates with the bigger picture. |
|