> I really wish there were more privacy considerations in how these pieces of meta data are handled.

When you Export a photo from Apple's Photos, there is a checkbox you can toggle for Location Information. I generally have that unchecked so that it strips that EXIF data from the resulting exported image.