It makes one wonder what intelligence really is. The more I think about it the more I feel that speed is a fundamental unit of intelligence, with the other being some simple computation unit. As in, intelligence = speed * simple computation.

If you look around us it is the ability to iterate that drives innovation (and thereby evidence of "intelligence"). LLMs in industry are more useful, and used, the faster they are.

> what intelligence really is

Something that actually arrives to good results - the faster the better, but you have to be able to finally achieve. Achievement of solutions is still far from granted - so we will have to remain focusing on that.

Intelligence finds good solutions in a solutions space.

Lately, I am thinking that intelligence is just a large memory + efficient search. I'm basing that off of multiple accounts of really smart people having extremely a good memory (I can only think of von Neumann right now, who could reproduce complete books)

I really like Gwern’s definition of intelligence which is “search over Turing machines”.

In other words, searching for the right program given some goal.