My advice is to search for the stuff you want on eBay, then filter results for sellers near you, identify some interesting sellers and try to visit their facility in person. If you buy through eBay, then a less awkward tactic is to choose "Local Pickup" instead of a delivery service. When you're at the facility, ask if you can take a look around or if they know of other sellers for used server equipment.

Spent some time doing this and came up with a new and used parts megastore not too far. Thanks for the idea!