Remix.run Logo
▲ gb2d_hn 2 days ago

No one knows if this is AI related, but it's easy to imagine that where changes written by AI fail in production, if AI can't find the solution (which will be common as AI access to production systems is typically reduced), then the devs won't either, or at least it will take them some time.

▲karmakurtisaani 2 days ago | parent | next [-]

Perhaps the velocity is the problem, not that AI inherently produces worse code (you just need one bad or just inexperienced engineer have their PR slip through to have bad human written code in you code base). When the velocity is high, there's less time to battle test each change and new code piles up on the old one. When the velocity is low, shitty code fails in production, but people are aware of what was recently changed and can find and fix the problems.

▲_kulang 2 days ago | parent | next [-]

Same thing, now, just faster: one bad engineer can now ship a million lines

▲karmakurtisaani 2 days ago | parent [-]

Well, yes. My point was more that even if the quality was better, the speed of change is a problem. In particular in mature systems, I should add.

▲gb2d_hn a day ago | parent [-]

I think this makes sense. If I ship 10 lines of code to production and something breaks, it's easier to reason about than if I shipped 1000 lines of code, even if I did read and understand them before shipping .

▲dabinat 2 days ago | parent | prev [-]

For some reason people seem to think that just because AI exists now, code no longer needs testing thoroughly.

▲karmakurtisaani 2 days ago | parent [-]

Yep, and having a ton of AI written unit tests pass is not the same as running incident free in production for a month.

▲lkramer 2 days ago | parent | prev | next [-]

The bigger issue with having your systems written by AI, is that nobody knows how the system works anymore and can't pinpoint where the likely failure points are.

▲gbalduzzi 2 days ago | parent | prev | next [-]

Maybe the error itself isn't event AI related, but the engineers that knew how to fix it were let go

▲solid_fuel 2 days ago | parent | prev [-]

The status updates have a pretty strong "LLM-driven agent failing to debug a complex system" feel to them. I hope it's not the case, but I could imagine a scenario in which inexperienced engineers - or experienced ones who have lost touch with the codebase - are deferring to LLMs to drive the troubleshooting and fix here.

▲koyote 2 days ago | parent [-]

They sound exactly like frustrating conversations I'd have with a cheap model and an overextended context window.