| ▲ | socalgal2 a day ago | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
> We are 4 years into this ‘revolution’ and the industry has almost nothing to show for it. Software has not improved in quality, Apple, Mozillia, and Firefox just released a record number of bug fixes because of AI. So this assertion that Software as not improved in quality is arguably if not provably false. There are 1000s of other examples. I have my own. Personal projects that were stopped because of dependency rot, having 100s of bugs fixed, nearly all dependencies removed, and lots of tests added just by asking. I know tons of others with similar experiences > I do not feel like I’m falling behind by not using them Obviously you are correct about "how you feel". But, this argument to me is more like a horse owner claming they don't feel like they're failling behind to trucks that can carry 10x, 100x, 1000x more than their horse. Sure, maybe the horse can go places the truck can't. For most uses the truck is better than the horse. > The LLM-generated PRs I get are still rubbish. I can't argue with that. I haven't seed the LLM-generated PRs "you" get. I can say though the LLM-generated bug reports I've seen are 1000x better than human ones. Human bug report "your software breaks, fix it!". LLM bug report "There is a bug in this specfic part of the code for these specific reasons and here's a repo I wrote to demonstrate the bug. Here's instructions on how to run the repo. There's the code to fix the bug. And, here's a test to show the bug is fixed." Is it perfect? No, sometimes the bug isn't real because the code can only be reached in situtations that can never happen. But still, 7 of 8 times it's a real bug and the bug report are the best I've ever received. you can go through this list: https://www.firefox.com/en-US/firefox/150.0/releasenotes/ and for those very few issues not still blocked you can read the examples | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | bendmorris a day ago | parent | next [-] | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
>For most uses the truck is better than the horse. I think you're talking past the author here, who says: >By not leaning into LLMs I’ve given myself the room to specialise in a smaller set of skills. So far that conscious decision is working out well, and I remain confident about my job security. "Most uses" might mean boilerplate and simple frontend work that LLMs can do easily because it's formulaic and doesn't require much creativity. OP is simply not doing that type of work. I don't think anyone sane is really claiming 100x or 1000x speedups anymore. Most people I talk to who use LLMs are closer to 1.5 or 2. Because their job is not mostly boilerplate, there is simply not that much room to be improved. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | qsera a day ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
>Apple, Mozillia, and Firefox just released a record number of bug fixes because of AI. A hidden metric here is the number of new bugs created by these fixes. If an LLM creates 10x bugs but create 5x more new bugs, then it is not really an improvement. Because that is 5x more bugs that the user has to observe and report (unless it is a security vulnerability, which the LLMs might detect) before it can be fixed. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | gr_norm a day ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
LLMs are very helpful as a debugging aid, yes, but in large part because the fixes tend to be small and verifiable. That this does not carry over to many other use cases is the crux of the problem. I myself use them to accelerate programming tasks, so I'm not anywhere near as pessimistic as the author, but the claimed multiples of productivity definitely haven't materialized for me. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | lproven 20 hours ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
> Obviously you are correct about "how you feel". I posted the link. I didn't write it. My name is Liam Proven, thus "lproven", while they are Joshua Barretto, thus "jsbarretto". | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ▲ | iammrpayments a day ago | parent | prev [-] | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Not the 1000x more productive numbers again please. Is this a meme or something? If you said +17% I might have taken you seriously. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||