It is instantly awkward. If you are there with one other person and you start talking, they assume you are talking to them.