Do they really? If your experience is with the free version of ChatGPT, I wouldn't be surprised if you're running a MoE with like 8-12B active params and <100B total.

(Just speculation on params, but I find a lot of "LLMs still hallucinate on non-coding problems" come from people using very-cost-optimised free models and drawing the wrong conclusions).

> If your experience is with the free version of ChatGPT,

Even the free version of ChatGPT shouldn't hallucinate, after all it uses a good enough model. And the answer is no, it's a combination of paid and free models coming from OpenAI, Claude and Google's Gemini (with this latter one actually badly miss-identifying a WW2 military dictator a couple of weeks ago, wrote about it here [1] )

[1] https://news.ycombinator.com/reply?id=50256321&goto=threads%...