Remix.run Logo
▲ timcobb 5 hours ago

> Trained from scratch

How are they training without pirating the Z library corpus and all that?

▲sigmar 5 hours ago | parent [-]

I interpret "scratch" to mean brand new weights. Not that they aren't training on a corpus of human text

▲timcobb 4 hours ago | parent [-]

Right but how did they get a corpus, how do they compete legally without distillation?

▲nolok 4 hours ago | parent [-]

[dead]