You can though. People eat gold all the time.

Fine: you can't physiologically sustain yourself on a diet of gold alone. Gold is not a nutritionally complete diet. If all you have to eat is gold, you will soon be dead.