IIRC there's a video by 3b1b that talks about that, and it is important that gaussians are closed under convolution.

That makes it an equilibrium point in function space, but the other half is why it's an a global attractor.