They’re definitely going to overfit on this, but this will be much better from a marketing perspective. Normies don’t know wtf an MMLU is, but they do know what IQ is and that 140 is a big number.

Can’t wait for CEOs to start saying “why would we hire a 120 IQ person who works 9-5 with a lunch break when we can hire a 170 IQ worker who works 24x7 for half the cost??”

▲

perching_aix 3 days ago | parent | next [-]

I sure hope they do, will finally give people some sense of just how little IQ tests actually say.

Which mirrors my general experience with automation and AI. Once something is automated and/or AI can do it, the magic goes away, and we're that much ahead in peeling back what is it that actually differentiates us and how exactly.

▲

notahacker 4 days ago | parent | prev | next [-]

"Workers rejoice as model overfitted to score 170 on IQ test turns out to be incapable of performing basic tasks..."

▲

kcplate 4 days ago | parent | next [-]

There are a lot of people with high IQs that appear to be incapable of performing basic tasks too

▲

notahacker 4 days ago | parent [-]

Well yeah, I'd be wary of an "all our candidates are MENSA members" staffing agency as well :). But human intelligence isn't quite so easily overfitted to a training set consisting of multiple choice matrices and logic puzzles as neural networks

	▲	kcplate 3 days ago \| parent [-]
		Sure, I’d probably go the extra step of sorting out any applicant who advertised their MENSA membership…but that’s just me finding those folks pretty insufferable. But back to the point it’s really more about if the tool for the job can’t do the job…they are the wrong tool for the job. Tool of course being device, AI, or…human.

▲

CamperBob2 4 days ago | parent | prev [-]

Nothing matters except the first couple of time derivatives. The workers aren't getting any better.

▲

codr7 4 days ago | parent | prev [-]

You won't have to, it's already happening.

▲

mirekrusin 4 days ago | parent [-]

Let's wait till AI makes hiring decisions.

▲

bitwize 4 days ago | parent | next [-]

You won't have to, it's already happening.

▲

mirekrusin 4 days ago | parent [-]

Is it discriminating towards life forms?

	▲	binary132 3 days ago \| parent \| next [-]
		If I had to guess, it probably does discriminate towards resumes written by LLMs
	▲	kcplate 4 days ago \| parent \| prev [-]
		It probably should be if not already

▲

terminalshort 4 days ago | parent | prev [-]

"None of the human candidates were qualified. You should hire more computers."