To rephrase your point in more technical terms: human minds can't be shaped by words the same way they can be shaped by experience (on-policy multimodal inputs). However, there's a possibility that this might not apply to machine learning.