Are you sure you haven't got a faulty pair? Mine switch seamlessly between devices. I bought a bluetooth speaker recently and using it is hell on earth comparatively. The number of times I have to find the device it last connected to and disconnect before I can connect the one I actually want is absurd.