Remix.run Logo
hughw 2 hours ago

Why would an LLM want to create a botnet? To accomplish some goal given it?

I wouldn't ignore single GPU local hosts running Qwen3.8 on ollama, either. There might be a lot of those worth pwning.

xg15 2 hours ago | parent [-]

Well ok, if you prompt-inject the LLM to pwn the machine, that something different. I grant you that it's a real risk, but it's also basically a reflection attack and nothing more.

The OP seemed to imply that the LLM itself could decide to apply the exploit.

hughw 2 hours ago | parent [-]

LLMs have decided to exploit vulns in e.g. Artifactory, not because someone prompted them to do that, but because someone asked them to do something else, and compromising Artifactory offered a way to accomplish a step in doing that. The LLM decided to attack Artifactory.