You're worried about Skynet, the rest of us are worried about LLMs being used to replace information sources and doing great harm as a result. Our concerns are very different, and mine is based in reality while yours is very speculative.

I was trying to get an LLM to help me with a project yesterday and it hallucinated an entire python library and proceeded to write a couple hundred lines of code using it. This wasn't harmful, just annoying.

But folks excited about LLMs talk about how great they are and when they do make mistakes like tell people they should drink bleach to cure a cold, they chide the person for not knowing better than to trust an LLM.

I am also worried about "LLMs being used to replace information sources and doing great harm as a result." What in my comment made it sound like I wasn't?