All information technology is killing privacy, deriving from the trend that it's getting easier to collect and copy data.

Of course it doesn't help that people tell their most secret thoughts to an LLM, but before ChatGPT people did that to Google.

The recent AI advancements do make it easier though to process large amounts of data that is already being collected through existing means, and distill them, which has negative consequences on privacy.

But the distillation power of LLMs can also be used for privacy preserving purposes, namely local inference. You don't need to go to recipe websites any more, or go to wikipedia, or stack overflow, but can ask your local model. Sadly though, the non-local ones are still distinguishably better than the locally running ones, and this is probably going to stay.