And yet, two people have solved it independently, so apparently it is adequately specified for some.

“Luck is not a strategy.”

I can successfully interpret total gibberish sometimes, but that’s not a robust approach even with humans let alone machines.

People have wildly different experiences utilising AI because of their own idiosyncrasies more than issues with the tools themselves.

It was pointed out by multiple groups (such as Anthropic) that their tools do a lot better with well organised codebases that are liberally commented.

I’ve worked on codebases where the AIs are just… lost. So are people!

Sure, some people can navigate the spaghetti… sometimes… but the success rate of changes is much lower.

Occasional success is not proof of correctness of approach. Consistent success is.