"You’re carrying around in your head a model of how the world works" (or so you thought) ... the real AI is in a) how fast you can realize it's changed and b) how fast you can adapt. This bit isn't being optimized, it's being dragged out.

> This bit isn't being optimized, it's being dragged out.

Of course, it is being optimized. People are working on increasing the sample efficiency. A simple search on Google Scholar will confirm it.