Remix.run Logo
simonw 6 hours ago

What kind of shape of evidence would you find convincing?

unknownfuture 6 hours ago | parent | next [-]

Self-reported or observational data capturing time spent for categories of task ala every other similar study in this space?

This isn't exactly novel territory, here, Simon. Let's not pretend I'm asking for something strange, unprecedented, or unreasonable.

simonw 5 hours ago | parent [-]

How's this? https://simonwillison.net/2026/Jul/13/datasette-code-frequen...

I have similar charts across my three main open source projects:

https://github.com/simonw/datasette/graphs/code-frequency

https://github.com/simonw/llm/graphs/code-frequency

https://github.com/simonw/sqlite-utils/graphs/code-frequency

unknownfuture 2 hours ago | parent | next [-]

The article mentions that coding is only a fraction of dev time and thus accelerating that part of the job can only create incremental gains, and oh PS, lines of code and similar metrics are a bad way if measuring dev productivity, anyway, and we've known that for decades.

The OP claims AI accelerates non-coding parts of the job, too, and so the article is misguided.

I ask for evidence.

In response you give me... code output metrics?

simonw an hour ago | parent [-]

I don't have anything else to hand that I can think of. I don't keep a time tracking diary.

qsera 4 hours ago | parent | prev | next [-]

I don't think volume of code changed was the metric the other commenter was asking for.

4 hours ago | parent [-]
[deleted]
the_af 4 hours ago | parent | prev [-]

Isn't this falling into the "lines of code" trap TFA mentions?

More code written is not a good measure of productivity. It could be garbage, or redundant code, or simply not addressing the real or more pressing needs, it could be building the wrong thing, etc.

Like TFA mentions, it's been known for decades LoC is a misleading metric for productivity. It's one of the lessons of software engineering.

simonw 2 hours ago | parent [-]

I'm planning an article at the moment in defense of lines of code. Saying "lines of code are a bad measurement" is too easy! It's about time someone presented an opposing argument.

In my specific case, lines of code for my published open source projects is a metric that I trust, because I have high standards for those. I have plenty of other projects where I'll accept poor quality, unreviewed code (almost all of https://github.com/simonw/tools for example), but Datasette, sqlite-utils and LLM are not that.

Of course, that's only useful for me personally and for people who trust me to stick to my own self-declared high standards!

otabdeveloper4 an hour ago | parent | next [-]

> Lines of code are akshually a good metric now, because that's the only metric LLMs can optimize and I really, really, really love LLMs, they're the bee's knees.

Really now?

simonw 40 minutes ago | parent [-]

No.

skydhash 35 minutes ago | parent | prev [-]

> Saying "lines of code are a bad measurement" is too easy! It's about time someone presented an opposing argument.

Maybe because there is none.

One of the main quality of good codebase is simplicity. Which is about how easy for someone else to understand the code. It’s hard to define what simplicity looks like, so the best bet is to avoid the other side, making the code too complex.

And you can make the code complex by shortening variable name, doing code golfing with quicks of the platforms, so smaller LoC. You can also go the other way and increase the LoC by adding unneeded abstractions, repeating slices of code,… There’s a window where the LoC is perfect to attain simplicity, but that amount is an effect of striving for simplicity, not a cause of it. And it’s variable for every problem.

So you got something where the correct value is a different for each case. And trying to manipulate it artificially often results in complex code. And you want to say that is a good metric for productivity?

And in the cases of your projects, there are a lot more info could share that are interesting, like the amount of issues (reported or found by you) that are tied to implementation bugs (coding, libraries API breakage,…) or design issues (requirements conflicts,…), documentation improvement,… Anything that is tied to the actual usefulness of the projects, and not fumbling around with code.

bluefirebrand 6 hours ago | parent | prev [-]

People working fewer hours :)

kaashif 6 hours ago | parent | next [-]

Damn, looks like we have lower productivity than cavemen!

keeda 5 hours ago | parent | prev [-]

Sir, this is Capitalism.