Remix.run Logo
▲ timr 19 hours ago

> This is a classic fallacy: that interview should look the same as the job. There is no reason[1] your evaluation pipeline has to necessarily resemble the task you are hiring for.

Well then. If the "classic fallacy" is that job interviews should reflect the actual job, then what does it really matter what we do? Let's just have a big pub quiz. That measures "intelligence", too.

> You could test people on random cognitive tasks and predict their job performance.

Show me a single piece of evidence that memorizing code golf answers from a book is a valid proxy for intelligence, and we'll talk.

(Hint: You'll have better luck convincing me that it's a stealth way of discriminating against older, more experienced applicants who are further from undergrad and less willing to re-memorize Cracking the Coding Interview for the 150th time. Because it actually is.)

In any case, I do not understand this...Stockholm syndrome...that some programmers seem to have for the idiotic interview system.

▲boorang 18 hours ago | parent | next [-]

> (Hint: You'll have better luck convincing me that it's a stealth way of discriminating against older, more experienced applicants who are further from undergrad and less willing to re-memorize Cracking the Coding Interview for the 150th time. Because it actually is.)

I hadn't actually thought about it this way, but it makes sense. I'm in my early 50s and hella experienced and talented (if i do say so myself), but I refuse to do any interviews that require me to do any more preparation than researching the company I'm applying to.

▲timr 17 hours ago | parent [-]

I think it's a common story for anyone who has been around a while: you have a career (possibly even working for big, famous names) develop a long resume of accomplishments, and some dinky startup with a staff of teenagers rejects you via email because you didn't solve a leetcode hard problem while singing and dancing on zoom.

It's obviously absurd, and while I almost understand it for a company that doesn't know you, you'll get hit with this stuff when you've been referred internally, by people you worked with in the past.

▲tgma 19 hours ago | parent | prev [-]

Obvious strawman: is "coin flipping tournament" a "random cognitive task?"

There is a century of data and studies that suggest cognitive ability is positively correlated across tasks. Conducting IQ tests for hiring is practically illegal in the US. Leetcode is the closest you get to an IQ test without tripping some laws.

▲timr 18 hours ago | parent | next [-]

Yes, I changed it to a better metaphor before you wrote your comment. I had originally written "pub quiz", then changed it to "coin flipping contest" to emphasize the stupidity of the task, then changed it back, anticipating the criticism. The argument does not change -- the claim that testing coding trivia is a test of intelligence is a bald assertion.

Please use your intelligence to see the argument I am making, instead of nitpicking the example.

> Conducting IQ tests for hiring is practically illegal in the US. Leetcode is the closest you get to an IQ test without tripping some laws.

No, it isn't. Disparate impact is. Any test that has a disparate impact on a protected class is de facto illegal, but there's case law surrounding IQ tests.

By the way...ironically enough, Griggs v. Duke Power established that any intelligence test must have relevance to the job responsibilities, which sort of blows a hole in your entire theory of the case that this is a "classic fallacy".

https://en.wikipedia.org/wiki/Griggs_v._Duke_Power_Co.

▲kelipso 17 hours ago | parent [-]

> the claim that testing coding trivia is a test of intelligence is a bald assertion

I think you have to let this one go. SAT, LSAT, GRE, ASVAB all correlate well with IQ scores. Leetcode should too, after the interviewee does a few weeks of practice (just like all those other tests).

▲timr 17 hours ago | parent [-]

> Leetcode should too, after the interviewee does a few weeks of practice (just like all those other tests).

I mean, you're just making stuff up, but ok.

▲tptacek 18 hours ago | parent | prev [-]

Not only is it not practically illegal, as the sibling commenter notes, but several household-name corporations openly IQ test candidates. General cognitive testing is presumptively lawful in white collar employment.

▲tgma 18 hours ago | parent [-]

Your pivot from "IQ test" in your first sentence to "general cognitive testing" in second is the whole point.

Leetcode is just one step away from that (and much more litigation-proof).

▲tptacek 18 hours ago | parent [-]

IQ tests are general cognitive tests. If your entire argument is that IQ tests are fine so long as you call them something else, you're not really saying anything.

Leetcode is not a general cognitive test, obviously.

▲tgma 18 hours ago | parent [-]

IQ tests are general cognitive tests. The opposite is not necessarily true.

The whole point of the multibillion dollar test industry is to fudge a "noisy" IQ[ish] test and make it look like it won't have disparate impact (validation "studied") and buy you some ass-covering ability.

> Leetcode...

"one step away"

▲tptacek 17 hours ago | parent [-]

Leetcode is a domain-specific test. It is the opposite thing to a general cognitive test. The entire point of IQ is the positive manifold: the notion that general cognitive tests are all monitoring the same latent variable.

If you're saying, like, the Wonderlic test is fine but IQ testing isn't, all you're saying is that the "IQ brand" is problematic. That's wrong, but also it's not saying anything interesting. Call it whatever you want, it's the same business premise.

If you're saying that Leetcode is, like the Wonderlic, a direct proxy for IQ, that's just clearly false.

▲tgma 17 hours ago | parent | next [-]

[flagged]

▲ 17 hours ago | parent | prev [-]
[deleted]