Remix.run Logo
▲ jacobgold a day ago

Our infrastructure will become so much more secure but we're in for a bumpy ride through 2027.

▲dvh a day ago | parent | next [-]

Not necessarily. Only if you assume that no new insecure code is added. If ai found 1 security bugs in old code but ease of code generation with ai adds 2 new security issues (in unrelated code), then we are getting less secure.

▲tyingq a day ago | parent | next [-]

Is it a given that it's as good at outputting secure code as it finding insecure code? That leaves a fair amount of room for people not baking in deep review steps. Also mentioned elsewhere, but if velocity is way up...that ramps up bugs anyway.

▲MajesticHobo2 a day ago | parent [-]

No, it's not a given. AI always finds security issues in the things I just had it write.

▲FrinkleFrankle a day ago | parent | next [-]

But that should be part of your pipeline, no? Personally, the thing I've spent the most time working on with AI is.. a stack to get AI to keep a project on track and follow strict code writing standards that are reviewed. Not everyone is working in that, but I'm sure any serious development will be done via something similar.

Although, at the pace of improvement, I'd bet it won't even be necessary in a year or so.

▲hparadiz a day ago | parent | prev [-]

This is true for human written code too. This is why in the future all written code MUST be run through an internal security sweep before being given to your harness for writing. That's just basic due diligence at this point.

▲vbezhenar a day ago | parent | next [-]

As long as model providers deny access to security-capable models, it can't be basic diligence.

▲hparadiz a day ago | parent | next [-]

This is something agents already do as part of their normal work. Providing code that you know is vulnerable is in fact a dereliction of duty and negligence. Don't provide a POC. Simply that as it produces code a background agent just checks it without showing the work and points out potential problems.

▲greyr0ck a day ago | parent | prev [-]

The slop is cheap but checking will cost extra, what a pricing scheme! Modern day Pharo level of lockin!

▲catlifeonmars a day ago | parent | prev [-]

Yes but LLMs famously produce vastly more code than humans. My hot take: LLMs will produce more insecure code than they can catch, and will also find ways to smuggle insecure code to avoid extra work.

▲SOLAR_FIELDS a day ago | parent | prev | next [-]

Do we have any evidence around the rate that AI emits security bugs vs humans previously? You would think that perhaps AI would be better about this, but perhaps not.

▲dvh a day ago | parent | next [-]

I'm making no claims. I'm just saying that contributing before ai was difficult so people rarely did it. Now that contributing is easy, more code will be added. More code = more bugs. Always.

▲voakbasda a day ago | parent [-]

Yet the opposite seems to be true. Many projects now shun new contributors due to AI.

▲punchmesan a day ago | parent | next [-]

Eh I'm not sure that's an indicator that the opposite is true. Github's vastly increased commit activity is the best indicator we have of this. https://www.tomshardware.com/software/github-report-highligh...

Sure, some projects are trying to be responsible or are trying to keep waves of slop PR's from drowning them, but that is by no means an indication of a general distaste for AI code. It's been largely embraced.

▲ranger_danger a day ago | parent | prev | next [-]

Are any of those large projects used by many people?

▲hparadiz a day ago | parent | prev [-]

I've run Daybreak against my human written pre-AI code and found so much stuff that I don't trust human or AI written code. It all MUST be audited by a security sweep AI.

▲the8472 a day ago | parent | prev [-]

Even if Fable and Astra are superhuman at identifying and fixing bugs that does nothing when projects get bugslopped faster and cheaper by some low-end model.

▲tptacek a day ago | parent | prev | next [-]

I hate these meta conversations on crunchy technical topics and feel like we should be digging into the KVM security model more than this general security prognostication stuff. Having said that, I will hypocritically further this debate by pointing out that the determinant of software security moving forward is not so whether AI is drastically better than humans at avoiding common vulnerability patterns, (or instead just a little better). Rather, it's that AI will make it much easier to move subsystems or whole projects to memory-safe programming languages and towards formal verification.

▲j45 a day ago | parent | prev [-]

Existing code will have security holes that haven't been found yet.

▲InsidiousWombat a day ago | parent | prev | next [-]

...if the pace of both fixing and finding bugs got accelerated, all we're in for is machines being on average more vulnerable (because patching takes time and effort and more bugs increases that)

▲TZubiri a day ago | parent | prev [-]

Have you ever been told that you are problematically optimistic?