Remix.run Logo
logicchains 6 hours ago

>Cause once AI makes arguments that require a working memory of hundred items, then we as humans will have no way of understanding the arguments…

That doesn't follow. We could still understand it just by studying it and committing it all to long-term memory, it just takes longer. And there's a hard cap on the working memory of LLMs, due to the quadratic scaling cost of the full attention layers that have proved unescapable for all SOTA LLMs.