> Weights are source in language models.

Weights are source in the same way as any x86 binary is source.

You easily modify a x86 binary and change behaviour or examine the machine code instructions. You probably are not aware how easy it is to change the behaviour of a binary executable.