In most cases, you don’t know if it came to the correct answer.

In every reasonable use case for LLMs verifying the answer is trivial. Does the code do what I wanted it to? Does it link to a source that corroborates the response?

If you're asking for things you can't easily verify you're barking up the wrong tree.