Anthropic paid a large settlement for the copyrighted data they pirated. So far, US courts have found that it's perfectly fine to train AIs on copyrighted data for which you have legal access.