>> A remaining advantage of large language models is that as they get larger, they tend to hallucinate less

First time I hear that...not really true.

"Understanding Why Language Models Hallucinate: Testing Reasoning Against Priors" - https://arxiv.org/abs/2607.00447

"Calibrated Language Models Must Hallucinate" - https://arxiv.org/abs/2311.14648

"TruthfulQA: Measuring How Models Mimic Human Falsehoods" - https://arxiv.org/abs/2109.07958