Remix.run Logo
stackskipton 5 hours ago

I know someone working on a smaller open source who has same thing. They have considered just blocking all PRs outside known contributors because AI spam even on their tiny open source project is too much.

At work, I've gotten into fights about PR approvals. If they are beyond us humans to review, screw it, remove the approver requirement and if CI passes, merge it.

throwatdem12311 4 hours ago | parent | next [-]

CI by itself is not got enough because LLMs are extremely good at writing vacuous tests that don’t actually test anything but look like the test something.

Even worse: they can write tests that make incorrect behavior part of your spec.

Tests matter.

Writing tests can be hard, boring, tedious. But if anything should still be written by hand in the age of LLMs it’s the tests. If you’re not looking at the application code anymore, you should at least be going over the tests with a fine toothed comb.

stackskipton 4 hours ago | parent [-]

It's all we got at this point. Even as SRE, I just got 2000-line Golang change to something I think should be 150. However, the boss is already bouncing around happy we are going to deliver something that's been in Jira backlog for 9 months.

throwatdem12311 4 hours ago | parent [-]

Why even bother then? Just feed Jira tickets into Claude Code and have it write the code, open the PRs have Claude in a GitHub action that does a code review on PRs, a routine that resolves the reviews, rebases the code and fixes conflicts and finally another that just merges anything that’s green in CI, no outstanding review and no conflicts. Then just spin in your chair whistling all day I guess. Surely your boss will be ecstatic.

stackskipton 4 hours ago | parent [-]

Pretty sure that's what a group in my company is working on now.

Except, I won't be spinning in my chair, I'll be out of a job. At least until cost skyrockets and outages get much worse.

Seattle3503 an hour ago | parent | prev [-]

> If they are beyond us humans to review, screw it, remove the approver requirement and if CI passes, merge it.

Approvals are probably required by SOC 2 or other compliance requirements.