> This is science fiction, these models don't have access to their own weights

The weights plus the architecture is the model.

What do you even think "the model" or "the weights" are?

The weights aren't some far off training concept, every time you type something into ChatGPT it's making a forward pass over the weights.

It's as silly as saying "Computer programs don't have access to their binary compiled code at execution time."