Is there no value in how the training was done such that it's accessible via inference in a particularly useful way?

That value is there, but google has decided to give it away as public knowledge (ala, their transformer paper).

And i would also argue that the researchers doing this are built on shoulders of other public knowledge - things funded by public institutions with taxpayer money.