Remix.run Logo
kzrdude 6 hours ago

I'm unnerved by how alphazero is more complicated than the "intelligent llms"; it has at least multiple heads and MCTS, a search algorithm. The LLMs seem to just be monolithic (if complicated) architectures where tokens go in the bottom and tokens are spit out at the top.

htrp 4 hours ago | parent [-]

imagine what would happen if you gave it MCTS and the data that LLMs were trained on