>Seems like it'd be pretty easy to diversify into inflation-protected assets after taking big profits.

Assets are yours only as long as there's a government to enforce your ownership rights over those assets for you. In case of government or societal collapse, your physical assets then are free for the taking to the ones with the most men with the most guns, and your paper assets are worthless.