Remix.run Logo
jennyholzer2 4 days ago

From my vantage I would argue LLMs make good devs around 0.65x more productive

roblh 4 days ago | parent | next [-]

I think they make good devs 2x more productive for the first month, which then slowly declines as that good dev spends less time actually writing and understanding and debugging code until it falls well below the 1x mark. It’s basically a high interest loan people take against their own skills. For some people that loan might be worth it. Maybe they’re trying to change their role in an organization and need the boost to start taking up new responsibilities they want to own. I think it’s temporary though. The slow shift into “skim mode”, where the authors just don’t quite put that same amount of effort into understanding what’s being churned out. I dunno, that’s just what I’ve seen.

candiddevmike 4 days ago | parent | next [-]

Because there's a mental overhead when you're not writing the code that is arguably worse than when you are writing the code. No one is talking about this enough IMO but that's why everyone is so exhausted when using LLMs and end up just pulling the slot machine until it works without actually reading it.

Reading code sucks, it always has. The flow state we all crave is when the code is in our working memory as an understood construct and we're just translating our mental model to a programming language. You don't get that with LLMs. It devolves into prorgamming minutae equivalent to "a little to the left" but with the added complexity that "left" is hundreds of lines of code.

AstroBen 4 days ago | parent | prev [-]

I really feel this myself.

If I write home-grown organic code then I have no choice but to fully understand the problem. Using an LLM it's very easy to be lazy, at least in the short term

Where does that get me after 3 months? I end up working on a codebase I barely understand. My own skills have degraded. It just gets worse the longer you go

This is also coming from my experience in the best case scenario: I enjoy coding and am working on something I care about the quality of. Lots of people don't have even that

dsego 4 days ago | parent | prev | next [-]

I think on average a dev can be x percent more productive, but there is a best case and worst case scenario. Sometimes it's a shortcut to crank out a solution quickly, other times the LLM can spin you in circles and you lose the whole day in a loop where the LLM is fixing its own mistakes, and it would've been easier to just spend some time working it out yourself.

bluGill 4 days ago | parent | prev | next [-]

Good devs are still learning how to use LLMs, and so are willing to accept the 0.65x once in a while. Any complex tool will have a learning curve. Most tools improve over time. As such good devs either have found how to use LLMs to make them more productive (probably not 10x, but even 1.1x is something), or they try them again every few months to see if things are better.

jennyholzer2 4 days ago | parent [-]

[flagged]

simonw 4 days ago | parent [-]

Hi, delusional developer reporting for duty here.

Avicebron 4 days ago | parent [-]

How are you measuring productivity these days Simon? Do you have a boss that has certain expectations? If you don't hit those are you going to lose your house?

simonw 4 days ago | parent [-]

I work for myself, so mainly through guilt and self-doubt.

wiml 4 days ago | parent [-]

One of the things LLMs are demonstrably good at is eliminating self-doubt. That's why they're so disastrous.

4 days ago | parent | prev | next [-]
[deleted]
jennyholzer2 4 days ago | parent [-]

[flagged]

coffeebeqn 4 days ago | parent | prev | next [-]

I just spent a day trying to get Claude to write reasonable unit tests and then after sleeping on it, reverted everything and did it myself. I’m not gonna be using it for a while because it 0.5x’d me once again

square_usual 4 days ago | parent | prev [-]

Yep, that's why very accomplished, widely regarded developers like Mitchell Hashimoto and Antirez use them. They need to make programming more challenging to keep it fun.

jennyholzer2 4 days ago | parent [-]

[flagged]

swah 4 days ago | parent [-]

Mitchell shares the Amp threads on how he delivered some smaller features/fixes.