Subreddits where SolidGoldMagikarp was counting to a million in comments were used to train a machine that then writes web pages that more machines are trained on. The sheer volume of data with sufficient verisimilitude generated by these models may well work to train robots. It might not, but I think it might well work. The idea that things have to be high-fidelity high-quality to yield good results has clearly not held up in other domains.