That's why the competitive moat for frontier LLMs is access to proprietary training data. OpenAI and their competitors are paying fortunes to license private data sets, and in some cases even hiring human experts to write custom documents on specific topics as additional training data. This is how they hope to stay ahead of open-source alternatives.