What you should note as quaint is probably more like the integration of more "symbolic" strategies to NNs in AI.

Past the initial sensation, it is pretty linear that "something good at language" (an interface) be integrated with "something good at information retrieval" (the data). (Still sought what comes next, "something to give reliability to processing".)