Language barriers are cultural barriers.

It's as simple as that. Most people do not expect to interact the way that most native English speakers expect.