To do that training, you must first obtain the item with the content you require. Did OpenAI purchase a copy of every book they trained their models on?

Answer: They did not. That is literally why there are dozens of ongoing lawsuits in progress.

For songs, it's not that hard to legally get access to it, I think. I'm not sure if Spotify can legally prevent you from using songs for AI training for example.