When the wood fibers get wet they swell and become soft. When soft, the surface will be very sensitive to damage. Fibers on the surface will raise and then not return to their original position, causing surface roughness. Repeated cycles of wet/dry will cause cracks.

From experience, even the cheapest wood spoons won't bulge, as long as you don't leave them immerged in water for a long time.