Regular Cloudflare + heavy caching should solve all crawling problems, no?
For most bot visits, there should not be a single database request.