If a human hallucinates or bullshits in a way that harms you or your company you can take action against them

That's the difference. AI cannot be held responsible for hallucinations that cause harm, therefore it cannot be incentivized to avoid that behavior, therefore it cannot be trusted

Simple as that

The question wasn't can it be trusted, it was does it think.