That would be "swearing in your vicinity" not "swearing at you".

A distinction clear to those with long familiarity to swearing and swear words.