And it will be increasingly hard to keep the slop of preceding generations out of the training data. The race to the bottom is inevitable.

I don't think that's particularly hard. AI labs are very selective about what they use for training. The days of indiscriminately scraping the entire internet and dumping that in, unfiltered, are long behind us.