Remix.run Logo
zwnow 7 hours ago

> Being able to not only look up but automatically integrate things into your codebase that already exist in some form in the training data is incredibly useful.

Until it decides to include code it gathered from a stackoverflow post 15 years ago probably introducing security related issues or makes up libraries on the go or even worse, tries to make u install libs that were part of a data poisoning attack.

MontyCarloHall 7 hours ago | parent [-]

It's no different from supervising a naïve junior engineer who also copy/pastes from 15 year old SO posts (a tale as old as time): you need to carefully review and actually grok the code the junior/AI writes. Sometimes this ends up taking longer than writing it yourself, sometimes it doesn't. As with all decisions in delegating work, the trick is knowing ahead of time whether this will be the case.

spzb 7 hours ago | parent | next [-]

Naive junior engineers eventually learn and become competent senior engineers. LLMs forget everything they "learn" as soon as the context window gets too big.

MontyCarloHall 7 hours ago | parent | next [-]

Very true! I liken AI to having an endless supply of newly hired interns with near-infinite knowledge but intern-level skills.

cheevly 5 hours ago | parent | prev [-]

There are like a dozen well-established ways to overcome this. Learn how to use the basic tools and patterns my dude.

zwnow 5 hours ago | parent | prev [-]

I have yet to see a junior trying to install random/non existing libs.

pigpop 5 hours ago | parent [-]

If you forced them to try it from memory without giving them access to the web you sure would.