LLMs can synthesize the domain knowledge so long as it's within their training data. At some point, blindly trusting the decisions they make becomes gambling.

There is this over indexing in training data that I find quite problematic.

I have really good results getting LLMs to read documentation and work of these. This is in domains probably sparsely represented in the training data.