There's something off with this because Haiku should not be that good.

I've been very curious about that too. I wonder if it's actually much better at admitting when it doesn't know something, because it thinks it's a "dumber model". But I haven't played with this at all myself.

The hallucination benchmark is hallucinating