How about put it this way, LLMs know more about us than we do them.

Not "know" in a generic sense. But an LLM trained in the intricacies of contract law can find more loopholes than you or your cheap lawyer can.

Now extrapolate that to LLMs RL-trained on many niche applications. Good and bad arguments available, but ultimately it seems like bot-vs-bot, as long as the bots are well trained for those niches.

Yeah but qualify the "know". Their "intentions" aren't conscious, but unknown.

Do you know, friend? I searched the entire thread.