Remix.run Logo
Blocking DDoS from scraper bots the easy way via HTTP-401 Basic Auth(blog.fraggod.net)
4 points by speckx 6 hours ago | 1 comments
rini17 6 hours ago | parent [-]

Many bots open new TCP connection for every request, which is incredibly wasteful but leads to easy filtering via ipt_hashlimit firewall rules. Browsers and other well behaved clients work fine with limit as low as 3 connections per minute per IP. It avoids the SSL handshake overhead too. YMMV of course, but worth trying out.