Beyond mirroring the engineering practices that you yourself want to see other people perform, have you found any techniques to get people to … in short, do their job again? Understand context, understand what they did, why they did it, what they’re doing, etc.

The +/-2000 line MR was bad when humans wrote it. It’s way worse when the human didn’t even write or read it.

And just vomiting automated CodeRabbit talking points back and forth at each other feels equally harmful.

Are we really tolerating turning ourselves into LLM rubber stamps?

▲

SpicyLemonZest 4 days ago | parent | next [-]

For me the trick was just leaning all the way into it. I had a residual idea that if someone sends me a 2000 line PR, 10 page design, etc., that this represents some concrete investment of time and effort that deserves my careful consideration. And it just doesn't anymore.

I have one project where there must be hundreds of pages of design proposals I have not read and will never read, because the author really likes having Claude generate complete design proposals based on incomplete understanding. So every week or two he sends me a new one, I spend 30 seconds skimming it, and then I tab back to Slack to ask him to explain.

I don't like working this way, but you know, I don't like doing rollouts either. It's certainly better than being a human rubberstamp.

▲

t-writescode 4 days ago | parent [-]

That sounds like a fantastic way for a malicious actor or an unintentional prompt injection exploit to sneak into a codebase.

Perhaps you could explain how this is different from rubber stamping, if it’s just 30 seconds of reading.

Does the conversation you have reveal what they actually want?

And what about the 2000 line change? Does that get stamped after someone talks about the change but without deeply reading it?

▲

SpicyLemonZest 4 days ago | parent [-]

Typically what happens is that we have a good conversation, we make progress towards figuring out what they should want to do and how they should try to do it, and the 2000 line PR or 10 page doc gets abandoned. I do read things in detail when I expect I might one day be convinced to approve them, but that fraction has plummeted from 95% to like 20% since January.

▲

t-writescode 4 days ago | parent [-]

Have you noticed an increase in their willingness to “do the right thing first time” during these last 6 months since your approval rate has dropped that much? (Even if the right thing is to have more conversations)?

Do you know if there’s a way to incentivize them to lean toward doing the right thing first? Are the company and stakeholder goals and objectives in line with them making progress toward higher quality engineering? That is, are these juniors protected from randoms asking them to circumvent good process, etc?

▲

SpicyLemonZest 4 days ago | parent [-]

Unfortunately, I've had a number of people explicitly defend that nothing's going wrong here. Their view is that, if sloppy code is cheap, everyone might as well produce some to illustrate their ideas before having a conversation. I'm skeptical of that position but haven't had much luck in fighting it.

> Are the company and stakeholder goals and objectives in line with them making progress toward higher quality engineering? That is, are these juniors protected from randoms asking them to circumvent good process, etc?

In my personal experience yes, but I've seen a few teams and heard stories of many more where the juniors are not protected and they just ship regressions and outages all the time now. I think the trend towards AI cost controls will mitigate this, although the impact will of course be uneven as companies behind the curve discover powerful agentic coding for the first time.

	▲	nozzlegear 3 days ago \| parent [-]
		You're fighting the good fight.

▲

paulhebert 4 days ago | parent | prev [-]

I tried to get our team to enforce a max PR size.

It worked for a while. There is a GitHub action that you can configure to fail if the PR is too large.

But then we started a new project and I didn’t add it right away since it’s a small team and I figured we could use the honor system.

Since then there have been lots of massive PRs but there’s not much willingness to go back to enforcing the rule because it might slow us down…

It’s frustrating.

	▲	t-writescode 4 days ago \| parent [-]
		Out of curiosity, with their current paradigm, what's the regression rate and how long do PRs stay in pending?