Remix.run Logo
nitwit005 10 hours ago

To me the issue isn't seeming inhuman, but cost. Employers often seem happy to impose rediculous time costs on the people they're hiring: take home tests, long series of interviews, etc. What held that back is they also paid a price. Full automation leaves them free to impose infinite cost with no guarantee of anything.

YesBox 6 hours ago | parent | next [-]

Applicants are using AI too. I've heard from people who hire/post jobs that they gets hundreds to low thousands of applications, and maybe 5% of them have any relevant experience. The problem is the breakdown of trust is costing all of us.

tdeck 3 hours ago | parent | next [-]

> Applicants are using AI too. I've heard from people who hire/post jobs that they gets hundreds to low thousands of applications, and maybe 5% of them have any relevant experience.

This happened before "AI" too. When all it takes is clicking an "apply now" button on LinkedIn some desperate people will spam any job they see.

Nursie 2 hours ago | parent [-]

And in some places they are incentivised to do so, as they may need to prove a certain number of applications per-week, or they'll lose unemployment benefits, so they end up applying to all sorts of unsuitable stuff.

slumberlust 6 hours ago | parent | prev | next [-]

The companies have made this bed. They are upset its finally a mor even playing field.

hexaga 4 hours ago | parent [-]

Everyone is upset because the situation is a trash fire.

stingraycharles 3 hours ago | parent [-]

Yeah, the playing field isn’t leveled as much as it’s simply on fire and turning into garbage. In a way it’s similar to the eternal September, but on a much broader scale.

hedora 4 hours ago | parent | prev | next [-]

For the 95% irrelevant and 5% relevant groups, I wonder what percentage of resumes come in through a third party recruiter.

I get tons of spam that could be generated by even a basic LLM based on public information about me, but for positions that are not a reasonable fit.

Apparently, it is common for such cold calls to come from “recruiters” that are not affiliated with the hiring firm, but are trying to collect some sort of referral bounty.

I have no idea why an HR department would be dumb enough to set up such a pipeline (by actually paying for the third party “service”), but I guess once they have the program in place, they also need an LLM to screen spam applications.

tharkun__ 5 hours ago | parent | prev [-]

Using AI for what and is it bad or good?

At this point, we think using AI and being able to use AI effectively is a skill in and of itself. When you're hired, you'll have access to AI. You'd be expected to be able to use said AI effectively.

So, we still give you a FizzBuzz. You can use AI. Even if we told you not to use AI, we know almost everyone would use AI. But you have to understand the FizzBuzz and be able to explain it to us and make changes to it "live". The amount of people that get weeded out just by having to explain the code they "coded themselves" is staggering (even pre-AI, even on a take home where you had no "OMG I suck at live coding" pressure).

hansvm 4 hours ago | parent | next [-]

It's been a year since I've actively given out take-homes for hiring, but I'm not sure I agree that everyone will use AI. I designed half the questions to be impossible for current-gen AI to answer without the candidate actually knowing what's going on [0], and only ~1% of candidates who responded did poorly on that half and not the other half (and, if we're worried about LLMs being better than I think, not all that many candidates passed most questions either).

[0] The most reliable strategy I've found for that is choosing questions where the wrong answer is the right answer for some much more common question. Actually spending a few seconds and solving the problem easily lets a human pass, but an LLM with insufficient weights or training data (all of them) doesn't stand a chance.

seer 2 hours ago | parent | next [-]

Thanks for clarifying - I kinda get the idea but would love to see an example for this.

I’ve mostly given up on all of the standard techniques for interviewing sadly, just because “using ai” makes a lot of them trivial, and have resorted to the good old fashioned interview, where I screen for drive, values and root cause seeking, and let people learn tech/frameworks/etc themselves.

But I was wondering, isn’t a take home question still good, if you give a more open ended and ambitious task, and let people vibe code the solution, review the result but ask for the prompt/session as well?

People will be doing that during normal work anyway, so why not test that directly?

vaginaphobic 5 minutes ago | parent | prev [-]

[dead]

JoshTriplett 4 hours ago | parent | prev [-]

> Even if we told you not to use AI, we know almost everyone would use AI.

You can likely control for that, if you either interview in person or via screen sharing. (Yes, it could be faked, but that's harder.)

hansvm 4 hours ago | parent | prev | next [-]

The last time I was hiring I gave out a take-home test, and I thought it was the opposite of an imposition on candidates' time. I'd be curious to hear your thoughts:

- It was designed to be fast to complete (20min max -- not a huge imposition if being hired is likely, obviously very expensive if you're taking one for every job posting).

- I only gave them out after a resume screen. If you had a 0% chance then I didn't waste your time. If you had enough other proof of abilities then I skipped the take-home.

- Candidates were told that it was designed to be fast and that if they couldn't complete it quickly they were unlikely to be successful interviewing either. They still had the option to spend a lot of time if they thought my assessment of the situation was wrong, but part of the point was to allow candidates to gauge their own abilities and not waste their time interviewing without a chance of being hired.

- I did a lot of work behind the scenes calibrating and re-writing the questions individually and as a whole so that the test score correlated very well with interview performance (most interviews administered by not-me, removing a form of bias that's easy to creep in there).

heavyset_go 4 hours ago | parent | next [-]

For every "20 min max" take home assignment, there will be people who are willing to spend 4+ hours doing it to outshine candidates who have jobs, families and lives.

If you want to make it more of a fair consideration of time, consider moving your take home to interviews, that way there isn't a time cost asymmetry. You can enforce your "20 min max" claim this way, you can judge a candidate's performance, thought process and filter out anyone who is LLMing or spending inordinate amounts of time on them.

You will also make a better impression on candidates by investing your time in them in the same way they are with you. Maybe you're hiring kids out of college without experience, but you only have to do so many take home tests before you realize that they're a waste of time, and pass on potential employers who throw them at you, or you learn to just send them your hourly rate for the test.

parpfish 3 hours ago | parent | next [-]

One other way to keep things true to the “20 min max” is to have a clear objective/scoring rubric. Nothing open ended (data science jobs LOVE handing out open ended data analyses). I need to know that it’s okay to stop and that anything I’m doing would just be overkill.

stbtrax 3 hours ago | parent | prev | next [-]

you can put a time limit on it from when they start to submit. It's really the only way to solve high volume of unqualified applicants. So much time wasted talking to people who could barely code

Barbing 3 hours ago | parent [-]

Submit 30min after interview, “you have 20min” (remainder for bio break or whatever)?

seer 2 hours ago | parent | prev [-]

Live coding during an interview is one of the most oppressive things I’ve witnessed in the industry in general.

There is usually a huge disconnect between someone who knows that “this task should take 20mins” and doing it cold in a super high-pressure environment.

People sweat, panic, brain freeze, and are just plain out stressed.

I’ll only OK something like this if we give out a similar but not the same task before the interview so a person can train a bit beforehand.

I’ve heard it all justified as “we want to see how you perform under pressure” but to me that has always sounded super flimsy - like if this is representative of how work is done at this organisation, then do I want to work there in the first place? And if it isn’t, why the hell are you putting people through this ringer in the first place, just sounds inhumane.

crobertsbmw 4 hours ago | parent | prev | next [-]

That seems reasonable. Some employers will hand out 3-6 hour assignments after a candidate’s resumes make it through an AI screening.

komali2 3 hours ago | parent | prev [-]

> but part of the point was to allow candidates to gauge their own abilities and not waste their time interviewing without a chance of being hired.

In my experience this is the wrong game theory. Unemployed people can make job hunting their full time job, so a 20 minute take home doesn't select for "who delivers the highest quality solution in the least amount of time," it selects for "who is the richest applicant who can burn hours on a take home to deliver a higher quality result than people with less time they can afford to spend?"

Also, nobody should ever self-select themselves out of an interview process. Passing a resume review and getting a callback is about 10% likely: for every job hunt, in my experience , candidates get about 10 callbacks for every 100 resume sends. From there, it's about 20% chance to get to final stage, and from there, maybe 50% to get an offer (you're either their first choice or second; if second, your hiring hinges on whether the first choice accepts). Math is right there: once you pass a resume check, in terms of the volume of applications you've sent, it's optimal to spend far more effort into this gig than into firing off ten or twenty more resumes.

Therefore, even if the candidate doesn't think they're a good fit, they should do everything they can to stay in the game, including lying by omission.

After all they might be engaging in imposter syndrome, right? Why assume for the interviewer that your python skills aren't good enough - maybe the interviewer understands perfectly well that you've only used it for scripts and one off tools, but doesn't care because they personally believe your startup experience is more valuable to them and they believe you can up skill! Maybe the take home was designed poorly by someone who was tasked randomly by a lead to shit out a take home, and it's not an accurate indication of what the job would be like. Maybe they sent you the wrong take home? Maybe it's a good take home but you need money so fuck it, if you manage to sneak in despite not being a good fit, you can just bust ass to upskill and make up the difference before anyone notices. Or fuck it twice, it's a shit market and who knows how much longer you'll be able to sell your labor as an engineer, even if you can only fool them for two weeks, that's two weeks of income while you still keep up your job hunt.

SchemaLoad 7 hours ago | parent | prev | next [-]

I hate the take homes because companies seem happy to send them out to people who have literally no chance. Sent after they already have a candidate in mind, sent before the resume has been reviewed, sent before the company has invested even a minute talking to you.

So you waste the weekend on this project when you had no chance from the beginning. And the time restrictions they list mean nothing since if you actually stop after x hours, they will just pick the person who spent the whole weekend and did a more complete job.

suzzer99 6 hours ago | parent [-]

I got dinged on my Netflix take home 10 years ago because I used the DOM to store state instead of implementing a shadow DOM. Sure, let me just whip that right up.

bluefirebrand 6 hours ago | parent | next [-]

Outstanding.

I've done quite a few interviews and as long as the interviewee maybe said something like "it would be better to use a shadow DOM" and could explain what a shadow DOM is, I would be pretty happy with that

Expecting someone to build a full shadow DOM as part of their interview take home is excessive

nitwit005 6 hours ago | parent | next [-]

Often times people ding you for doing anything different than they're used to, or what they see as "the standard".

The worst is when they basically ask how you'd build their product. Some people can't handle a different answer, even as they're busy hiring you to improve things.

tharkun__ 5 hours ago | parent | next [-]

I do think we have to distinguish two things though.

It's not really bad to ask someone to do a design session with them and "build their product with them from scratch" isn't inherently bad. That's actually pretty neat if you ask me.

What's bad is if there's only a single answer and that's whatever they actually built themselves, which might be a pile of thrown together startup poo that was never cleaned up. But you have the same problem with all sorts of "needless trivia" type questions.

And then do you really want to work at a company, where you can't have a proper "pros and cons of different approaches" type of discussion? If you got hired, you'd have those kinds of discussions with them on an ongoing basis. Bad on the company for letting that person do the hiring but they got what they deserved so to speak.

Just to make an analogy:

If they simply ding you for using 4 spaces coz they use 8, that's bad.

If they ask you why you use 4 spaces, they use 8, give them pros and cons and are there any other approaches and what are the pros and cons of those? That's a good interview so to speak. As an interviewer I would give bonus points if the candidate says something like "I used 4 spaces because I thought that's what you guys were probably using coz everyone's moved away from 8 spaces but secretly I love usings tabs and setting tabwidth to what I want but in reality it really really doesn't matter as long as it's consistent across the codebase as humans can get used to almost everything and this one isn't worth fighting over. Linters and formatters exist for a reason".

suzzer99 4 hours ago | parent [-]

2 spaces ftmfw. I want to see as much on the screen as possible. Horizontal scrolling is bad.

Who still uses 8? Isn't that like a COBOL thing?

fwipsy 4 hours ago | parent | next [-]

Linux kernel still uses 8 I believe. IIRC wide indentation+narrow pages were chosen partly to encourage using functions and avoiding deep nested logic.

https://www.kernel.org/doc/html/v4.10/process/coding-style.h...

fragmede 4 hours ago | parent | prev [-]

Let's compromise. What do you think of 3?

dotancohen 3 hours ago | parent | next [-]

I just recently read about something that requires - hard requirement - 3 spaces for indentation. Most likely read it here on HN. Makes me sick to even think about.

suzzer99 an hour ago | parent | prev | next [-]

Authorities have been notified.

mystraline 3 hours ago | parent | prev [-]

Just add a few zero width spaces. It'll be FINEEEEE :D

https://en.wikipedia.org/wiki/Zero-width_space

Btw, at an old job, some joker developer added or copied 1, and broke the whole testbed. It was quite funny. I came over to the sourcecode hosted in Gitlab, ran my regexes that look for naughty characters. Found it after it ate the devs for half a day.

operatingthetan 3 hours ago | parent | prev | next [-]

Engineering interviews in tech are arbitrary and biased by design.

bitwize 2 hours ago | parent | prev [-]

This. No hire if, when asked an open-ended question, the candidate does not namedrop unprompted the components of the company's actual production tech stack. Clearly they're not knowledgeable about the engineering aspects of the job and are just bluffing their way through the interview process.

SchemaLoad 2 hours ago | parent | prev | next [-]

Often you don't even get to the interview step. One time I had a take home that said you could either do frontend only, backend only, or full stack. I decided to pick the backend only one and complete all of the optional backend tasks to make something pretty well made.

Then they email me back and said the other candidate did the whole thing and they aren't sure if I know how to style a page now because I only completed the backend part.

parpfish 4 hours ago | parent | prev [-]

The inability to get feedback and course-correct is my biggest peeve with take homes.

Is this one of the tests where I just need to throw together a five minute quickie to get over your “can you program” filter? or do you need me to put together something flashy and memorable to show off my ceiling? If o put together my flashy thing, would I get dinged for over-engineering something where a five minute hack solution was good enough?

vaginaphobic a few seconds ago | parent | prev [-]

[dead]

bbkane 9 hours ago | parent | prev [-]

Employers are also inundated by applications so they're applying higher bars to meet as a sort of back pressure.

I hate it from the candidates' perspective, but it's not illogical from the employer perspective.

No, I don't know how to fix it.

nitwit005 9 hours ago | parent | next [-]

Getting a lot of applications that don't meet your standard doesn't force you to raise you bar. You still just need someone who meets your standard.

It's quite rare for companies to have evidence to support their hiring methods, which unfortunately means it's heavily driven by trends.

tmoertel 7 hours ago | parent [-]

> Getting a lot of applications that don't meet your standard doesn't force you to raise you[r] bar. You still just need someone who meets your standard.

I'm not sure that first sentence true. Let me play Devil's advocate:

What's the primary cause of not being able to find someone who meets your standard when you already get lots of applications? It's that your hiring process is bogged down by the masses of unwanted candidates you must evaluate to find the few wanted candidates in the crowd of applicants. And what's the fix? It's better screening. Which is raising your bar, isn't it? Even if it's only to add cargo-cult screens to your bar, it's making the bar more selective, isn't it? Fewer people clear it, right?

nitwit005 7 hours ago | parent [-]

Arbitrary filtering of candidates is always an option, but then you may as well do it as cheaply as possible. Throw out half the resumes.

dwohnitmok 6 hours ago | parent [-]

Arbitrary filtering of candidates doesn't reduce the effort that it takes. Let's say 1 out of 1000 of the candidates you see is what you need. The total amount of effort to find the right candidate is still the same. But throwing out half the resumes just doubles the amount of time until you find the candidate you need (you just spread lower effort over a longer time).

On the other hand if you "raise your bar" (let's say you do so by some method that makes it twice as expensive to judge a candidate; twice as likely to reject a candidate that would fit what you need, i.e. doubles your false negative rate; but cuts down on the number of applications by 10x, so that now 1 out of 100 candidates are what you need, which isn't that far off the mark for certain kinds of things), you cut down the effort (and time) you need to spend on finding a candidate by over double.

EDIT: On reflection I think we're mainly talking past each other. You are thinking of a scenario where all stages take roughly the same amount of effort/time, whereas tmorel and I are thinking of a scenario where different stages take different amounts of effort/time. If you "raise the bar" on the stages that take less amount of effort/time (assuming that those stages still have some amount of selection usefulness) then you will reduce the overall amount of time/energy spent on hiring someone that meets your final bar.

nitwit005 6 hours ago | parent [-]

I wasn't suggesting arbitrarily removing candidates was a good idea, but simply responding to their specific devils advocate example of applying "cargo cult screens", which would presumably be arbitrary.

hunterpayne 6 hours ago | parent | prev | next [-]

And why would this be the case? Maybe the solution is to ban AI from the hiring process. This seems like companies being hoisted by their own petard. This is because they are the ones who drove the hiring market to be this way. They are the ones who started using AI in the hiring process. They are the ones who decided to make applying so much work driving applicants to use AI to survive.

Also, if you are having trouble hiring right now, that is 1000% a skill issue. It is easier to hire good talent right now than ever before. So I have absolutely 0 sympathy for this POV. Go down to your HR department if you want to see who is at fault.

PS You fix it by charging $1 to apply for jobs. Took me all of 30 seconds to figure that one out.

switchbak 5 hours ago | parent | next [-]

> charging $1 to apply for jobs

Yeah, I don't see anyone lining up to game that system. Maybe you ought to think about that a little longer than 30 seconds.

diacritical 5 hours ago | parent | prev | next [-]

I wouldn't pay anything to a company I'm applying to, but I would gladly send a small amount of money to a charity and show them the relevant bank or cryptocurrency proof if they explain why they need the micropayment. They could present me with a list of 10 or 10000 charities, I'd pick 1 and put "micropayment for applying to company X" in the comment of the payment.

That way I know I'm not giving money to some huge corporation and they know I think applying to their job should at least cost me Y amounts of currency.

And if they waste more than an hour of my time with the hiring process, they could similarly pay a charity some money per hour.

That was neither me nor the company will feel cheated and in the end, no matter how the hiring turns out, a charity will have benefited.

fwipsy 4 hours ago | parent [-]

To avoid overhead for many small payments, start a platform where users can buy many credits at once by contributing larger amounts to charity. Then, you burn your credits to apply to companies (or cold message applicants) to show you're not just spraying and praying.

diacritical 3 hours ago | parent [-]

Some more thoughts before I go to bed.

This could also be used for combating spam elsewhere, like posting in forums, comment sections and so on. To preserve privacy, something like zero-knowledge proofs could be utilized. I don't know how the cryptography would work exactly, but if you can't double spend a credit and you can choose whether to keep it anonymous or not, it could work, too. It would be best if for a given credit spent, you could only disclose your identity to the entity you want access to, not the credit issuing entity.

For spam, it seems like the cost of maintaining a forum like the servers are much lower than the cost of the mods that deal with spam. So instead of paying the forum directly, we lower the need for human mods to spend their time. That way we lower resources to the forum indirectly. The credits could be per post or per account creation. I assume the HN mods' time is worth a lot more than the servers and power HN runs on.

Also, we won't have the issue that PoW and other proofs-of-X's have of being easier to do on some devices, but harder on others (like the power and time it takes to run PoW on a beefy desktop with AES-NI vs an on old phone).

But we'll still have the issue with different standards of living in different places making the credits more or less expensive for the user subjectively. Companies hiring worldwide could require different amounts of credits for applicants from different countries, but for forums this wouldn't work.

A solution to that could be issuers giving credits for local volunteering work. Clean up some garbage from the shore and get a credit regardless of whether you're in the USA or Bangladesh. But if you want to prevent credits from being traded (do we? idk) and, at the same time, have some amount of privacy, how would you do it?

But now you'd have to make sure that credit issuers all over the world only issue credits for real charity-like work. And who's to say how to value picking up garbage vs volunteering at an animal shelter vs donating 1$ to a charity.

It's interesting to think about this, even though I don't have any resource to implement anything like that.

encom 5 hours ago | parent | prev [-]

You have invented micro-payments, which has never worked, ever.

mistrial9 4 hours ago | parent [-]

micro-payments were sabotaged by existing financial interests on multiple levels

sds357 8 hours ago | parent | prev | next [-]

Maybe we should go back to show up in person to drop off your resume

ccosky 2 hours ago | parent [-]

I wouldn't be surprised if eventually hiring becomes heavily dependent on personal referrals. That way you know you're at least dealing with a real person and not a bot, a North Korean trying to infiltrate your company, or someone who isn't even authorized to work in your country.

eikenberry 7 hours ago | parent | prev | next [-]

Smaller companies is one fix. These are almost all problems of fast growth and scale.

ChrisMarshallNY 4 hours ago | parent [-]

The problem is that spambots don’t care how big the company is. I know folks that advertised local Office Manager positions for tiny companies, and got hundreds of totally unqualified and unrelated rèsumès, and that was before AI was common.

The “good” news, was, that it was pretty easy to bin the spam.

RobotToaster 9 hours ago | parent | prev | next [-]

Require paper application.

If someone has to pay for a stamp it will stop spam applications.

deathanatos 7 hours ago | parent [-]

… needing to pay for postage hardly stops the spam I receive in my own mail. Even the most trivially absurd stuff, like "install rooftop solar" — I don't own a roof.

4 hours ago | parent [-]
[deleted]
gedy 9 hours ago | parent | prev | next [-]

In the end companies don't need to hook up to the sewer pipe that floods applications. What worked in past was (heaven forbid) technical hiring manager looking at resumes, etc and reaching out to clearly qualified candidates. Not hr 20-somethings with humanities degrees. Sorry

tayo42 7 hours ago | parent | prev [-]

Certification process like what Cisco has.

All companies attempt to give the same interviews, just have one centralized organization give two programing questions and two system design questions and some kind of proof once you pass it.

You filter every one that can't pass the interview in the first place, you get a better interview experience, and just focus on experience

singleshot_ 7 hours ago | parent [-]

This sounds an awful lot like a college diploma.

bigfishrunning 6 hours ago | parent | next [-]

Lots of people get through engineering school but are terrible engineers. Interviews are important (and difficult... Not many people are good interviewers!)

tayo42 7 hours ago | parent | prev [-]

Colleges aren't all equal.

Professional certifications are different

hunterpayne 6 hours ago | parent [-]

Professional certifications have a terrible reputation for good reason. You are perhaps too young to know why this is a silly idea. But its been tried and it failed spectacularly.

acheron 6 hours ago | parent | next [-]

It works in essentially every other profession. Programming isn’t that special.

jjmarr 4 hours ago | parent | next [-]

In essentially every other profession the credential is gated behind years of work experience and often a degree or course.

We already have such a credential. It's called "lasting two years at a FAANG+ without getting fired". If you do that you can get interviews anywhere.

operatingthetan 3 hours ago | parent | prev [-]

It appears that the coding job will be some variation will be some variation of vibecoding going forward, so a professional cert might be good enough.

tayo42 3 hours ago | parent | prev [-]

I have an example of a certification that is useful in my first comment...