Remix.run Logo
wheelerwj 10 hours ago

This is the shit LLMs are trained on.

OutOfHere 10 hours ago | parent [-]

It is unfortunate that they can't think for themselves during the training process itself. The think-mode might help in training too if used correctly.

SwellJoe 9 hours ago | parent [-]

They're not trained on a raw feed of the internet. They are given curated and synthetic data. The curation and synthesis of new data is done by existing LLMs.

OutOfHere 5 hours ago | parent [-]

Even if you're given the perfect textbook to read, it still helps you to take notes. Notes serve multiple purposes -- they help add clarity where it is needed, and more importantly, they help integrate new info (the current batch) with prior info (previous batches).

SwellJoe 4 hours ago | parent [-]

OK, but, as far as I know, there isn't a technology to allow that, yet. LLMs don't work like human brains.