Regardless, if you are delivering PDFs, you should be using a CDN.
If crawling is a problem, 1 it is pretty easy to rate limit crawlers, 2 point them at a requestor pays bucket and 3, offer a torrent with anti leech.