I'd argue the LLMs certainly distribute copyright material. That's why it can do things like:
https://g.co/gemini/share/20843b4609d9
Now, you could argue quotes are fair use - but can you argue the material isn't part of the LLM?