Remix.run Logo
▲ OccamsMirror an hour ago

How many of the security issues found were created by LLMs in the first place, though?

▲plorkyeran 39 minutes ago | parent | next [-]

My job is seeing a similar deluge of security work and >90% of the bugs have been in pre-2024 code, and zero of them have been bugs introduced after we were first officially allowed to use LLM codegen.

▲ecshafer 26 minutes ago | parent | prev | next [-]

Software is incredibly complicated. When you get into areas like security and networking and the internet its even more complicated. We rely on layers upon layers of software and hoping they are all done perfectly with no issues. The amount of junior devs, or outsourced devs for $10 an hour working on security relevant code is very very high, and always has been. LLMs if used correctly should be raising the floor.

▲drfloyd51 44 minutes ago | parent | prev | next [-]

Considering the software is much older than LLMs. Not many.

Also, in the article they mention a significant number of patches for older versions as well.

▲idiotsecant 12 minutes ago | parent | prev | next [-]

An uncomfortable truth about the era of LLM code is that machine produced code is, on average, quite a bit more secure than human code.

▲adwn 43 minutes ago | parent | prev [-]

Do you mean "created" as in LLMs were used to discover existing vulnerabilities, or as in LLMs wrote unsecure code? If it's the latter, then the answer probably is "very few". Frontier models have been better than the average programmer at writing secure code that follows up-to-date best-practices for some time now.