In a sense, LLMs emergently figured out the deep structure of language before we did, and that’s the most remarkable thing about them.

I dunno, it seems you have figured it out too, probably before LLMs?

I'd say all speakers of all languages have figured it out and your statement is quite confusing, at least to me.