| ▲ | kzrdude 6 hours ago | |
I'm unnerved by how alphazero is more complicated than the "intelligent llms"; it has at least multiple heads and MCTS, a search algorithm. The LLMs seem to just be monolithic (if complicated) architectures where tokens go in the bottom and tokens are spit out at the top. | ||
| ▲ | htrp 4 hours ago | parent [-] | |
imagine what would happen if you gave it MCTS and the data that LLMs were trained on | ||