The money didn't disappear, it just changed hands.

You are forgetting the opportunity cost. The gold does not generate wealth it just stores value, like a mattress stuffed with bills. It has become a dead, stagnant, and unproductive thing and by doing that it has removed value from the overall economy that was previously there.