Remix.run Logo
alphazard 4 days ago

IQ is a discovery about how intelligence occurs in humans. As you mentioned, a single factor explains most of the performance of a human on an IQ test, and that model is better than theories of multiple orthogonal intelligences. To contrast, 5 orthogonal factors are the best model we have for human personality.

The first question to ask is "do LLMs also have a general factor?". How much of an LLMs performance on an IQ test can be explained by a single positive correlation between all questions? I would expect LLMs to perform much better on memory tasks than anything else, and I wouldn't be surprised if that was holding up their scores. Is there a multi factor model that better explains LLM performance on these tests?

og_kalu 4 days ago | parent | next [-]

>The first question to ask is "do LLMs also have a general factor?".

Yes, there is some research about it here - https://www.sciencedirect.com/science/article/pii/S016028962...

naveen99 4 days ago | parent | prev [-]

Some points on the 4 ? or 5 dimensional personality space correlate with higher iq though.

alphazard 4 days ago | parent [-]

That may be the case. The personality traits are mostly uncorrelated with one another.

I was trying to give an example of what a successful multi factor model looks like (the Big 5) to then contrast it with a multi factor model that doesn't work well (theories of multiple intelligences).