Remix.run Logo
▲ jcomp 2 hours ago

As the percentage of LLM-generated stuff in the world increases relative to natural stuff, I don't see how it's possible to continue to train new models indefinitely. At some point, won't LLMs be trained on a corpus that is majority LLM-generated data, with everything that entails both good and bad? Seems to me that singularity is just going to kick off a self-reinforcing spiral... Bigger minds than me have to have considered this, is this a legitimate concern?