LLMs need documentation for semantic instructions and testing for formal verification. In the past efficient human teams could forego both of these and rely on tacit understanding. But this does not exist with LLMs so we will continue to see proliferation of elaborate documentation bases and test bases.

It is very interesting to me how the differences in our intelligences is physically manifested in text. It is one argument against hard-takeoff: the bioneuron can encode information in a sweet spot that cannot be targeted by the perceptron, by the so-called neuralese, by any amount of distillation.