Yes, I have no objection to that part. It's the arguments that training itself is the problem.

Sarah Silverman as the most prominent example.

I mean the act of reproducing the copyrighted material is what is illegal. LLMs I've used for coding has outputted exact copyrights for code verbatim into my code before. When that happens it feels kind of fishy to be honest.