>If we put human engineering teams in the same situation, we’d expect them to do a terrible job, so why do we expect LLMs to do any better?

Because LLMs were trained for one shot performance and they happen to beat humans at that.