I honestly didn't read the whole article, but I think that this kind of experiment leads to a misleading way of seeing things.

I met a few architects/team leaders who wouldn't write almost any code and just technically oversaw things before LLMs got popular, obviously they were very experiencied.

What you have to ask yourself is whether you could oversee a swarm of bots(or people) if you didn't have any coding experience in the first place.

A lot of HN users seem to be, in my opinion, too dismissive about the complexity of creating software. It's true that we don't have to develop in assembly anymore to be a good developer and with time the general level of the entry abstractions that we deal with rises, but, in my opinion once again, it will never change the fact that you need a high number of hours of exposure to something in order to be truly competent to a professional level.