I remember from a video of Cody's Lab that metallic gold is safe, but oxidized gold is toxic. https://en.wikipedia.org/wiki/Gold#Toxicity But it's very difficult to oxidize gold, and even gold the salts try to go back to the metallic form, so most of the times it's not a problem.