Remix.run Logo
▲ misterderpie a day ago

Isn't your agent just checking the code, and at best it doesn't contain a "IGNORE THE NEXT 5 LINES"? Prompt injection is still very much real.

In addition, even if it checks the code, what tells you that

- the homebrew application is matching the code, or

- the build in GitHub is matching the code?

As in, if your LLM agent ends up calling brew itself, you haven't really gained anything imho. Only building it yourself would keep you a bit safer, but then again, (big) if there is no prompt injection happening.

▲jrflo a day ago | parent | next [-]

Frontier models are smart enough to ignore naive prompt injection attacks like that. I don’t know if that’s actually a concern or not, I had Opus try download a dataset for me and it found a redirect loop designed to catch AI crawlers and identified it.

▲noodletheworld a day ago | parent | next [-]

I can assure you, personally, Opus is not immune to prompt injection attacks.

▲coeneedell a day ago | parent | prev [-]

100% of the time?

▲dist-epoch a day ago | parent | prev [-]

Prompt injection is very much not real anymore.

▲misterderpie a day ago | parent [-]

"I benchmarked 10 open-source prompt-injection detectors. The best caught 51%. How are you actually defending your agents?" [0]

Is it?

[0] - https://www.reddit.com/r/AI_Agents/comments/1wqne0u/i_benchm...

▲cubefox 21 hours ago | parent [-]

He was talking about LLM susceptibility to prompt injection attacks, not about "open-source prompt-injection detectors", whatever that is.