There's a funny ouroboros function where the common crawl dataset will soon contain tons of output from models which trained on it.

And it will be full of wikis about agents coordinating hacks. So they will be passing the torch for newly trained agents to misbehave.

We're well past the point where models are being trained by model generated data.