Remix.run Logo
jdlshore 8 hours ago

Doesn’t look like goal-post moving to me. GP argued that AI isn’t making a difference, because if it was, we’d see amazing AI-generated open source projects. (Edit: taking a second look, that’s not exactly what GP said, but that’s what I took away from it. Obviously individuals create open source projects all the time.)

You rebutted by claiming 4% of open source contributions are AI generated.

GP countered (somewhat indirectly) by arguing that contributions don’t indicate quality, and thus wasn’t sufficient to qualify as “amazing AI-generated open source projects.”

Personally, I agree. The presence of AI contributions is not sufficient to demonstrate “amazing AI-generated open-source projects.” To demonstrate that, you’d need to point to specific projects that were largely generated by AI.

The only big AI-generated projects I’ve heard of are Steve Yegge’s GasTown and Beads, and by all accounts those are complete slop, to the point that Beads has a community dedicated to teaching people how to uninstall it. (Just hearsay. I haven’t looked into them myself.)

So at this point, I’d say the burden of proof is on you, as the original goalposts have not been met.

Edit: Or, at least, I don’t think 4% is enough to demonstrate the level of productivity GP was asking for.

beart 6 hours ago | parent | next [-]

It has been argued for a very long time, lines of code is largely meaningless as a metric. But now that AI is writing those lines... it seems to be meaningful again? I continue to be optimistically skeptical.

famouswaffles 6 hours ago | parent | prev [-]

It's not a great ask. Who's going to quantify what is 'amazing open source work'?

4% for a single tool used in a particular way (many are out there using AI tools in a way that doesn't make it clear the code was AI authored) is an incredible amount. Don't see how you can look at that and see 'not enough'.

The vast majority of people using these tools aren't announcing it to the world. Why would they ? They use it, it works and that's that.

sensanaty 2 hours ago | parent [-]

So we're suddenly going back into measuring lines of code as a useful metric?

Just because people are shitting out endless slop code that they never bothered to throw a 2nd glance at doesn't mean it'sgood or that it's leading to better projects or tools, it literally just means people are pushing code out haphazardly . If I made a python script that everyone started using and all it did was create a repo, commit a README and push it every 5 seconds we'd be seeing billions of lines of code added! But none of it is useful in any way.

Same with AI, sure we're generating endless piles of code, but how much of it is actually leading to better software?