I interpret "scratch" to mean brand new weights. Not that they aren't training on a corpus of human text

Right but how did they get a corpus, how do they compete legally without distillation?