> some apps even prompt me to disable it!

That's social engineering to get themselves more background network activity. I wouldn't trust such an app.