Would be great to add a few human benchmarks on this (e.g., average US IQ, Ivy League average, human 80th percentile). Also understanding some IQ per cost metric could be fun.

Overall this is fun but not sure anyone in their right mind will be selecting an LLM based on this IQ benchmark

▲

jedberg 3 days ago | parent [-]

The IQ curve is designed so that 100 is average. So two of your questions can be answered with math:

> average US IQ

100

>human 80th percentile

113

The last one, Ivy League average, can be guessed based on published data. The median SAT score of an Ivy League attendee is 1500. A 1500 on the SAT is roughly an IQ of 130-140.

So in theory, the median Ivy League attendee is at the genius level.

	▲	ahmedhawas123 3 days ago \| parent [-]
		Thanks. My comment was less a question of what the numbers are, but rather provide visual benchmarks on the IQ visualization, since IQ is a metric usually used for humans.