It creates a lot of uncertainty. Especially if you depend more and more on them in your day to day life.

If your always-on agent hears to wrong thing, you could lose access to things you depend on. The same reason makes GCP very unattractive.