Can’t we say the same about LLMs? Yet interpretability of them is rough.

We can build black boxes and exploit the behavior of what we see.

But we can’t always go to deeper and deeper layers of understanding.

QM is not a black boxes we built but one could perhaps say it’s a black box that we see.