Most content on the internet has been optimized to get attention, not to represent truth.

AI trained on most content will be filled with misconceptions and contradictions.

Recent research has been showing that culling bad training data has a huge positive impact on model capabilities. Something like 99% of positive model capabilities comes from 10% of the training data (forget exactly).

I really hope that AI business models don't fall into relying on getting and keeping attention. I also hope the owners and creators of them exist in a win-win relationship with society as a whole. If AIs compete with each other based on which best represent truth, then overall things could get a lot better.