Doesn't that imply that, "everywhere" was, precisely, a single point?

No, why would it imply that?

One theory that might help you visualize an alternative is that the big bang was basically two 3D universes (floating in higher-dimensional space) slapping against each other really hard. That creates an explosion everywhere even if everywhere is quite big or even infinite.