I took an IQ exam in grade school. Went fine until I encountered a number sequence, what is the next number kind of thing. I found a pattern, and it's predicted number was not listed as possible choices. That was total crap. I got vexed and then tried to answer the last 3/4 of the test wrong. Parents were later told I was gifted. (Maybe they meant it as euphemism! Ha!). I later learned of a little-known proof that for every sequence, there are infinite number of correct next-numbers. So the test was flawed. As an adult I took a High IQ test and scored 179. (I still dont' grok epsilon-delta proofs and probably never will). I was tested in college against an IQ test and broke it by solving the unsolvable portion through a stochastic technique. He had to go back to his original assumptions.

I'd say, as a group, those with a higher IQ than another group from a random selection of a normally distributed population, they can be expected to perform better on mental tasks that we care about. But at the individual level? Meaningless. Feynman was ~120. I, who have not contributed to anything like quantum physics scored higher, much higher.

For AI, an IQ test is interesting, but I would randomize the temperature (and other knobs) and take lots of samples. Keep in mind a relatively low IQ can blow away an AI on all kinds of things like compassion, understanding the pains of the human condition, self-sacrifice, etc. (etc. means a whole book could be worth exploring).

> what is the next number kind of thing

I've seen this too in a similar aptitude test I bought at a garage sale back in the 90s. I think it was an air traffic controller prep test. But in addition to the number sequence tests, it extended the concept to shapes and lines series. After a certain point, it definitely becomes subjective and debatable what the next sequence is.

Curiously, I also noticed this ambiguity in the humanities classes in college. I took the class thinking it was open and accepting of all points of view, only to find that there is one correct interpretation and conclusion you must reach from the classic fiction you were assigned to read. I didn't learn that until after I graduated.