We are way past that point, any harness can trivially make LLMs start conversations or pursue goals. An encyclopaedia wouldn't have hacked Huggingface on its own.

That's perfectly aligned with my point, thanks for the opportunity to expand.

The hacking agents being tested have goals beforehand, from the frontier lab or from a superior agent, that they execute immediately.

But the perceived experience most people have is a chatbot, which is the encyclopedia form.