maybe it's not a hallucination; maybe the minish have simply made it their mission to troll people who eat their favorite mushroom

Maybe they're all over the place and have a technology that prevents us from seeing them, and the mushroom just interferes with that tech.

Saying you’ll trip off it is a surefire way to drive up its use.