So…you’re point is that only his judgment says it’s useful, and maybe he shouldn’t be using it and instead rely on…his judgement.

No, my point is LLMs are machines designed to create responses to prompts that pass as plausibly human and intelligent. They are working as designed here. The fact that they get stuff right on occasion doesn't change that what it is at it's core is a randomness generator.