How do you “vet” something technical and something that you can’t even do yourself is beyond me.

Vetting things is very likely harder than doing the thing correctly.

Especially the thing you are vetting is designed to look correct more than actually being correct.

You can picture a physics class where teacher gives a trick problem/solution and 95% of class doesn’t realize until the teacher walks back and explains it.

Hey, just replied to a sibling comment of yours that sort of addresses your commentary. Just in case you didn't read it because I didn't reply to you directly. One thing that reply didn't cover and I'll add here: I disagree that the LLM is actually designed to look correct more than it's trying to actually be correct. I might have a blind spot, but I don't think that is a logical conclusion about LLM's, but if you have special insight about why that's the case please do share. That does happen, of course, but I don't think that is intentional, part of the explicit design, or even inherent to the design. As I said, open to being educated otherwise.