Remix.run Logo
▲ slopinthebag 6 hours ago

cognitive abilities correlate across a particular set of measured tasks but it's not established that high performance in those tasks generalises to arbitrary domains

theres a difference between having a general capacity to learn, possessing domain-specific expertise, and being able to reliably apply that expertise in the real world.

even in humans, a genius mathematician isn't necessarily an exceptional manager, composer, or biologist. general intelligence might make it easier to acquire those skills but it doesn't substitute for them.

the question isn't whether LLMs exhibit "g" but if the abilities being measured are representative of the broader capabilities we're predicting. that's not something g settles.