> This is why LLMs are so strong at coding, because it's overrepresented in training data. My guess is that if you ask a frontier model about makeup, you will see it repeat cosmetic company's copy rather than getting a chemistry lesson.)

ChatGPTs response to the question “I want to learn about makeup”, gave me an overview of what makeup does, how it affects perceived structure, complexion, evenness, geometry, texture, etc.

When you then ask “the chemistry of makeup”, it goes into interesting breadth and depth without seeming like proprietary information. I do t get “corporate PR or marketing” vibes.