you can just ask it to explain those things!

Sure, and it will explain it to you from the same embedding space that yielded the solution that LRU cache is unbeatable.

It'll just be telling you what the data it ingested claims. Not what is necessarily true. It's as subject to garbage in, garbage out as anything, and you don't know what it's actually trained on.