If you think that is bad... Recently I discovered that even a tiny website with moderate textual content basically forces adoption of cloudflare due to incredible (~2k request per second at times) scraping by bots.

It isn't even a shakedown, they are genuinely protecting you from others. But how did we get to the point on the web that this is needed?