“Always listening” in the way people have been conspiratorially claiming your phone is listening to show you ads is silly.

Always listening in that the owner could run an application that could be recording them and you on the other hand has been a possibility since pretty much day one.

That's a good point, anyone with a smart phone could trivial have a voice recorder going all day and run it through whisper