There have even been times where an LLM will spit out _the exact same code_ and you have to give it the answer or a hint how to do it better

Yeah. I had the same experience doing code reviews at work. Sometimes people just get stuck on a problem and can't think of alternative approaches until you give them a good hint.