| ▲ | matteoraso 3 hours ago | |
Wouldn't reducing the entropy too much lead to lack of diversity of thought? An idea that I've had for a while is that LLMs are held back by having the same mind, leading to modal collapse. Ideally, an AI swarm would have different approaches to a problem so they don't all end up trying the same thing. | ||
| ▲ | dsign 2 hours ago | parent [-] | |
Drugs! Give'em psychedelics, let 'em see da colors! Nah, just kidding. The labs are training their models on the previous' version conversations, but I'm sure not all those conversations are weighted equal. So there are some conversations that are more "sparky", where both LLM and human work better towards achieving a solution. The next LLM iteration learns from them. In that sense, they don't need to hallucinate, but to do exactly what LLM dissenters say they do: "they just regurgitate something they saw (trained on) somewhere". To us humans, who haven't read all the books nor experienced a dozen million successfully completed tasks, that "rehashing of knowledge" (I prefer "recombination of knowledge") is more than good enough to solve ever more challenging problems...at least as long as there's a human in the loop with ever bigger ambitions. | ||