Remix.run Logo
DenisM 5 days ago

Free tier provides a lot of training material. Every time you correct ChatGPT on its mistakes you’re giving them knowledge that’s not in any book or website.

Thats a moat, albeit one that is slow to build.

dcre 5 days ago | parent [-]

That's interesting, though you have to imagine the data set is very low quality on average and distilling high quality training pairs out of it is very costly.

DenisM 4 days ago | parent [-]

Hence exponential increase in model training costs. Also hallucinations in the long tail of knowledge.