What I am worried about (and it's something about regular internet search that has worried me for the past ~10 years or so) is that, after they've trained a generation of folks to rely on this tech, they're going to start inserting things into the training data (or whatever the method would be) to bias it towards favoring certain agendas wrt the information it presents to the users in response to their queries.

> after they've trained a generation of folks to rely on this tech ... bias it towards favoring certain agendas

previously, this happened with print media. Then it happened with the airwaves. It only makes logical sense that the trend continues with LLMs.

Basically, the fundamental issue is that the source of information is under someone else's control, and that someone will always have an agenda.

But with LLMs, it's crucial to try change the trend. IMHO, it should be possible for a regular person to own their computing - this should include the LLM capability/hardware, as well as the model(s). Without such capabilities, the exact same will happen as has in the past with new technologies.

Absolutely. Like most things on the Internet, it will get enshittified. I think it is very likely that at some point there will be "ads" in the form of the chat bot giving recommendations that favor certain products and services.