I was talking with my father, and we said something in french that was close to "siri", and his iphone started talking, answering things like it was a search.

Unless siri activates with explicit user request, I can totally see this happening for many people.