Not all of the EU is in schengen, but we do have freedom of movement. Ireland for example is not in Schengen and never will be because of our travel arrangements with the UK.