You are underestimating the importance of attention. You can have everything in context and still attend to the wrong parts (eg bad names)