Remix.run Logo
MarcelOlsz 5 days ago

100%. I just went through an interview process where I absolutely killed the assignment (had the best one they'd seen), had positive signal/feedback from multiple engineers, CEO liked me a lot etc, only to get sunk by a CTO who thought it would be cool to give me a surprise live test because of "vibe coding paranoia". 11 weeks in the process, didn't get the role. Beyond fucking stupid.

This was the demo/take-home (for https://monumental.co): https://github.com/rublev/monumental

johnfn 4 days ago | parent | next [-]

It's funny because this repo really does seem vibe-coded. Obviously I have no reason not to believe you, but man! All those emojis in the install shell script - I've never seen anyone other than an AI do that :) Maybe you're the coder that the AI companies trained their AI on.

Sorry about the job interview. That sucks.

Tenemo 4 days ago | parent | next [-]

There's even a rocket emoji in server console.logs... There are memes with ChatGPT and rocket emojis as a sign of AI use. The whole repo looks super vibe-coded, emojis, abundance of redundant comments, all in perfect English and grammar, and the readme also has that "chatty" feel to it.

I'm not saying that using AI for take-home assignments is bad/unethical overall, but you need to be honest about it. If he was lying to them about not using any AI assistance to write all those emojis and folder structure map in the repo, then the CTO had a good nose and rightfully caught him.

photonthug 4 days ago | parent | next [-]

As a big believer in documentation and communication in general, there's this inevitable double-bind that people hate whatever you give them and also hate it if you give them nothing. LLMs have made this worse.

No emojis and any effort to be comprehensive? Everyone complains "what is this wall of text", or "this is industry not grad school so cut it out with the fancy stuff" or "no one spends that much time on anything and it must be AI generated". (Frequently just a way of saying that they hate to read, and naively believe that even irreducibly complex stuff is actually simple).

Stuff that's got emojis, a friendly casual tone and isn't information dense? Well that's very chatty and cute, it also has to be AI and can't be valuable.

Since you can't win with docs, the best approach is to produce high quality diagrams that are simultaneously useful for a wide audience from novice to expert. The only problem is that even producing high quality diagrams at a ratio of 1 diagram per 1k lines of code is still very time consuming to produce if you're putting lots of thought into it, double so if you're fighting the diagramming tools, or if you want something that's easy for multiple stakeholders with potentially very different job descriptions to take in. Everyone will call it inadequate, ask why it took so long, and ask for the missing docs that they will hate anyway!

On the bright side, LLMs are pretty great at generating mermaid, either from code, or natural language descriptions of data-flows. Diagrams-as-code without needing a whole application UI or one of a limited number of your orgs lucid-chart licenses is making "Don't like it? Submit a PR" a pretty small ask. Skin in the game helps to curbs endless bike-shedding criticism

saghm 4 days ago | parent [-]

> No emojis and any effort to be comprehensive? Everyone complains "what is this wall of text", or "this is industry not grad school so cut it out with the fancy stuff" or "no one spends that much time on anything and it must be AI generated". (Frequently just a way of saying that they hate to read, and naively believe that even irreducibly complex stuff is actually simple).

> Stuff that's got emojis, a friendly casual tone and isn't information dense? Well that's very chatty and cute, it also has to be AI and can't be valuable.

As a counterpoint, I can confidently say that I've never once had anyone give any feedback to me on the presence or absence of emojis in code I've written, whether for an interview, work, or personal projects, and I've never had anyone accuse my documentation of being AI generated or gotten feedback in an interview that my code didn't have enough documentation. There's a pretty wide spectrum between "indistinguishable from what I get when I give an LLM the same assignment as my interviewee" and "lacking any sort of human-readable documentation whatsoever".

userbinator 4 days ago | parent | prev | next [-]

If you're using AI for an interview, you are basically telling them "you could just not bother with hiring me and use AI yourself" which is neither good for you nor them.

lupire 4 days ago | parent [-]

In 2025, everyone is hiring for people who can use AI to write software. They already are using AI themselves. They need more people who can.

userbinator 3 days ago | parent [-]

Not everyone. I know there are some employers who are extremely against any form of AI being used in making their products.

MarcelOlsz 4 days ago | parent | prev [-]

Oh my god Becky, there's even a rocket emoji in the server console logs!

Should I also be "honest" about tab-completion? Where do you draw the line? Maybe I should be punished for having an internet connection too. Using AI for docker/readme's/simple scaffolding I would have done anyways? Oh the horror!

There was no lying because there was no discussion or mention of AI at all. Had they asked me, I'd have happily told them yes I obviously use AI to help me save time on grunt-work, I've been doing this stuff for like 15 years.

It's an unpaid take-home assignment. You'd have to be smoking crack to think that I would be rawdogging this. Imagine if I had a family or a wife or an existing job? I'd dump them after getting linked their assignment document.

Honestly at this point in the AI winter if you are a guy who has AI-inspired paranoia then I don't want to work for you because you are not "in the know".

sarchertech 4 days ago | parent | next [-]

You have that you’re the founder of an AI company in your hacker news profile, and your take home looks completely vibe coded. Why in the world are you surprised that a hiring manager is a little suspicious about your coding skills?

Given what you’ve said in your other comments, it seems like you used AI in a way that I wouldn’t have a problem with but just briefly looking through I can see how it would look suspicious.

MarcelOlsz 4 days ago | parent [-]

That's all well and good. Totally ask me about AI, I can talk a lot about it. Don't however, make me go through 99% of the interview process up until the very last stage (spanning weeks), and throw a live test in my face, and then have the hiring manager clarify that it's about "vibe coding paranoia". It negates the entire reason I did the take-home assignment.

raincole 4 days ago | parent | prev | next [-]

> It's an unpaid take-home assignment

It's not defensible in any case.

That being said, I think the CTO's "vide coding paranoid" after seeing this repo is 100% justified.

saghm 4 days ago | parent | prev | next [-]

> Should I also be "honest" about tab-completion? Where do you draw the line?

I'd probably draw it somewhere in the miles-long gap between tab completion and generating code with an LLM. It sounds like that's where the company drew it too.

4 days ago | parent | prev [-]
[deleted]
MarcelOlsz 4 days ago | parent | prev [-]

I used AI for the Docker setup which I've already done before. I'm not wasting time on that. Yeah you can vibe code basic backend and frontend and whatnot, but you're not going to vibe code your way to a full inverse kinematics solution.

I'm not a math/university educated guy so this was truly "from the ground up" for me despite the math being simple. I was quite proud of that.

Tenemo 4 days ago | parent [-]

So what was the issue the CTO had with vibe coding? Had you disclosed to then that you used LLMs for coding "basic" features outside the math and whatnot?

postsantum 4 days ago | parent | next [-]

CTO's previous job was at Palantir, perhaps he has some reasons to be paranoid

MarcelOlsz 4 days ago | parent | prev [-]

The hiring manager told me that they were getting a lot of "signal to noise" ratio in terms of their hiring, where they'd bring someone on-site who had a good assignment and apparently more often than not, these candidates would shit the bed in a live environment. So the CTO made a live take-home assignment and didn't tell anyone. I was told that he did this to weed out the low signal-to-noise people they dealt with recently.

>Had you disclosed to then that you used LLMs for coding "basic" features outside the math and whatnot?

No it seems completely immaterial. I'll happily talk about it if asked but it's just another tool in the shed. Great for scaffolding but makes me want to rip my hair out more often than not. If it doesn't one-shot something simple for me it has no use because it's infuriating to use. I didn't get into programming because I liked writing English.

jonnycoder 4 days ago | parent | prev | next [-]

Hah I feel you there. Around 2 years ago I did a take home assignment for a hiring manager (scientist) for Merck. The part B of the assignment was to decode binary data and there were 3 challenges: easy, medium and hard.

I spent around 40 hours of time and during my second interview, the manager didn't like my answer about how I would design the UI so he quickly wished me luck and ended the call. The first interview went really well.

For a couple of months, I kept asking the recruiter if anyone successfully solved the coding challenge and he said nobody did except me.

Out of respect, I posted the challenge and the solution on my github after waiting one year.

Part 2 is the challenging part; it's mostly a problem solving thing and less of a coding problem: https://github.com/jonnycoder1/merck_coding_challenge

lupire 4 days ago | parent | next [-]

Enjoy the ultimate classic tour de force from world treasure Chung-chieh (Ken) Shan’s wikiblog "Proper Treatment"

discussion / punchline http://conway.rutgers.edu/~ccshan/wiki/blog/posts/WordNumber...

Start of main content: http://conway.rutgers.edu/~ccshan/wiki/blog/posts/WordNumber...

userbinator 4 days ago | parent | prev | next [-]

Part 2 is the challenging part; it's mostly a problem solving thing and less of a coding problem

That doesn't look too challenging for anyone who has experience in low-level programming, embedded systems, and reverse engineering. In fact for me it'd be far easier than part 1, as I've done plenty of work similar to the latter, but not the former.

MarcelOlsz 4 days ago | parent | prev [-]

That sucks so hard man, very disrespectful. We should team up and start out own company. I tried checking out your repo but this stuff is several stops past my station lol.

_whiteCaps_ 4 days ago | parent | prev | next [-]

A surprise live test is absolutely the wrong approach for validating whether someone's done the work. IMO the correct approach is to go through the existing code with the applicant and have them explain how it works. Someone who used AI to build it (or in the past had someone else build it for them) wouldn't be able to do a deep dive into the code.

MarcelOlsz 4 days ago | parent [-]

We did go into the assignment after I gently bowed out of the goofy live test. The CTO seemed uninterested & unfamiliar with it after returning from a 3 week vacation during the whole process. I waited. Was happy to run him through it all. Talked about how to extend this to a real-world scenario and all that, which I did fantastically well at.

djmips 4 days ago | parent [-]

I feel your pain. This isn't a question about AI or not. It's about if you can do the work and do it well. This kind of nonsense happened before AI. If you can't win the game of Jeapordy you don't get the job which has nothing to do with being a Jeapordy contestant!

tracker1 4 days ago | parent | prev | next [-]

Damn... that's WAY more than I'll do for an interview process assignment... I usually time box myself to an hour or two max. I think the most I did was a tic-tac-toe engine but ran out of time before I could make a UI over it.

MarcelOlsz 4 days ago | parent [-]

I put absolutely every egg into that basket. The prospect of working in Europe (where I planned to return to eventually) working on cool robot stuff was enticing.

The fucking CTO thought I vibe-coded it and dismissed me. Shout-out to the hiring manager though, he was real.

_whiteCaps_ 4 days ago | parent | prev | next [-]

That is an insane amount of work for a job application. Were you compensated for it at all?

Jensson 4 days ago | parent | next [-]

It isn't impressive to spend a lot of time on a hiring problem, you shouldn't do that. If you can't do it in a few hours then just move on and apply for another job, you aren't the person they are looking for.

Doing it slowly over many days is only taking your time and probably wont get you the job anyway since the solution will be a hard to read mess compared to someone who solves it quickly since they are familiar with the domain.

userbinator 4 days ago | parent | prev | next [-]

The other comments here note that, and the author even stated it directly, that it was vibe-coded.

MarcelOlsz 3 days ago | parent [-]

Wrong.

MarcelOlsz 4 days ago | parent | prev [-]

No. Should I invoice them? I'm still livid about it. The kicker is the position pays a max of 60-120k euros, the maximum being what I made 5 years ago.

zipy124 4 days ago | parent | next [-]

TBF that's a pretty top tier salary for Europe.

MarcelOlsz 4 days ago | parent [-]

Right but we both know nobody is being offered the 120 right out the gate, so it's more like 100 max.

_whiteCaps_ 4 days ago | parent | prev [-]

Probably too late now unfortunately.

The job market is brutal right now, and you have my sympathy. I hope you can find a good fit soon.

MarcelOlsz 4 days ago | parent [-]

Much appreciated.

fooker 4 days ago | parent | prev | next [-]

This repo has enough red flags to warrant some suspicion.

You have also not attempted to hide that, which is interesting.

samiv 5 days ago | parent | prev | next [-]

Wait, what.. you did this as a take home for a position? Damn that looks excessive.

MarcelOlsz 4 days ago | parent [-]

Yes. I put a ton of work into it. I had about 60 pages worth of notes. On inverse kinematics, FABRIK, cyclic algorithms used in robotics, A*/RRT for real-world scenarios etc. I was super prepared. Talked to the CEO for about two hours. Took notes on all videos I can find of team members on youtube and their company.

Luckily the hiring manager called me back and levelled with me, nobody kept him in the loop and he felt terrible about it.

Some stupid contrived dumbed down version of this crane demo was used for the live test where I had to build some telemetry crap. Nerves took over, mind blanked.

Here's the take-home assignment requirements btw: https://i.imgur.com/HGL5g8t.png.

Here's the live assignment requirements: [1] https://i.imgur.com/aaiy7QR.png & [2] https://i.imgur.com/aaiy7QR.png.

At this rate I'm probably going to starve to death before I get a job. Should I write a blog post about my last 2 years of experiences? They are comically bad.

This was for monumental.co - found them in the HN who's hiring threads.

suzzer99 4 days ago | parent | next [-]

> Nerves took over, mind blanked.

This never happened to me in a job interview before I turned 40. But once I knew I was too old to look the part, and therefore and had to knock it out of the park, mind blank came roaring in. I have so much empathy now for anyone it ever happened to when I was giving the a job interview. Performing under that kind of pressure has nothing to do with actual ability to do the job.

pedrosorio 4 days ago | parent | prev | next [-]

> Here's the live assignment requirements: [1] https://i.imgur.com/aaiy7QR.png & [2] https://i.imgur.com/aaiy7QR.png.

These are the same link

samiv 4 days ago | parent | prev | next [-]

I feel bad for you, and I support you in naming and shaming this company. It's just horseshit to jerk people around like that.

I hope you can at least leverage this demo. Maybe remove the identifications of it and shove it into your CV as a "hobby project"? It looks pretty good for that.

Best!

MarcelOlsz 4 days ago | parent [-]

Thanks man, I'm pretty much forced to do exactly that.

dsff3f3f3f 4 days ago | parent | prev [-]

Their hiring process seems absolutely absurd.

MarcelOlsz 4 days ago | parent [-]

They probably think they are geniuses who "weeded out another AI guy!" High fives all around! It was a great process (for me) right up until it wasn't.

tayo42 4 days ago | parent | prev [-]

how much did this job pay?

MarcelOlsz 4 days ago | parent [-]

60k-120k euros. The upper 20k probably being entirely inaccessible so in reality probably like 70-100k euros.

tayo42 4 days ago | parent [-]

It's always these low pay jobs that have the sloppiest interview experiences

achenet 4 days ago | parent | next [-]

In at least parts of Europe, 70k-100k is pretty good for a mid/senior developer.

bowsamic 4 days ago | parent [-]

It’s the market rate in my city in Germany (not Berlin not Munich). I pivoted from non CS academia and entered software at 73k

MarcelOlsz 4 days ago | parent | prev [-]

I find it's less about the salary than it is the type of company. Any startup doing anything they consider remotely "cutting edge" is going to probably be a shit show.