There was an exhibit at the Exploratorium demonstrating a similar effect. You speak into a device and it plays your voice back to you delayed. If you're also listening for the other person this makes it impossible to speak. You can easily ignore it by just not paying attention to the audio back but it's surprising how, if you have to listen, this delay ruins everything. Someone saying a different thing, on the other hand, is easy to listen to while speaking.