This has basically happened already in all but exact form: https://statmodeling.stat.columbia.edu/2026/08/27/258/. I bet somebody out there is working on a textbook right now as I type this, or maybe they're already about to click the button to publish (maybe even ask the LLM to click it for him/her). The case talked about at the link is particularly egregious, it seems like some otherwise intelligent and mostly grounded people, even tenured academics in STEM fields, are completely unaware of the dangers of relying on LLMs for accurate knowledge. AI is either inducing some kind of psychosis in them or people with pre-existing problems with psychosis are just using AI as a tool, it's getting harder to differentiate between these scenarios.