Remix.run Logo
▲ prometheus1992 2 hours ago

>>you would predict that the LLM would reach some kind of universal information state, but that doesn't seem to be the case?

maybe a 50T parameter will do better on this benchmark. you can already see signs of the models discussing trade offs in great length and this falls somewhere in that direction.

▲thrw045 2 hours ago | parent [-]

It would be interesting if that were the case.