I mean, they did publish the word2vec and transformers papers, which are both of major significance to the development of LLMs.

Something that Google, in hindsight, regrets.