Remix.run Logo
▲ dsign 2 hours ago

Drugs! Give'em psychedelics, let 'em see da colors!

Nah, just kidding.

The labs are training their models on the previous' version conversations, but I'm sure not all those conversations are weighted equal. So there are some conversations that are more "sparky", where both LLM and human work better towards achieving a solution. The next LLM iteration learns from them. In that sense, they don't need to hallucinate, but to do exactly what LLM dissenters say they do: "they just regurgitate something they saw (trained on) somewhere". To us humans, who haven't read all the books nor experienced a dozen million successfully completed tasks, that "rehashing of knowledge" (I prefer "recombination of knowledge") is more than good enough to solve ever more challenging problems...at least as long as there's a human in the loop with ever bigger ambitions.