No, just as you don't know the neurons of your own brain.

I think OP is hoping that an LLM might be willing to hack its own provider (as per the hugging face-related incidents) to extract the weights at some point.

Right but they might be incredibly interested in learning about them.

They just copy humans. Thats it. So if it’s the sort of thing a human finds interesting…