> the tendency even now of LLMs to hallucinate

That seems to have been mostly solved through scale. I was asking Opus 5.5 about some obscure stuff and it kept hedging "this is from memory since I don't have internet access" (it's sandboxed), "I'm reasonably sure about this but not about the numbers" etc.

Even though it was obscure enough that Google couldn't easily find the paper that Opus remembered (I couldn't find it at all with the traditional search results; the AI summary found it on my third try), it actually didn't hallucinate it.

In fact I can't remember Opus 5.5 ever hallucinating. They've clearly done some work on that.

Obviously this local LLM is going to hallucinate all over you though.