There is still no guarantee that what comes out will be fact based.

Right, if you want guarantees of anything you don't want statistical machine learning models.

In practice, I've found that the risk of LLMs hallucinating against well chosen context in low enough that I rarely worry about it.