| ▲ | Blocking DDoS from scraper bots the easy way via HTTP-401 Basic Auth(blog.fraggod.net) | |
| 4 points by speckx 6 hours ago | 1 comments | ||
| ▲ | rini17 6 hours ago | parent [-] | |
Many bots open new TCP connection for every request, which is incredibly wasteful but leads to easy filtering via ipt_hashlimit firewall rules. Browsers and other well behaved clients work fine with limit as low as 3 connections per minute per IP. It avoids the SSL handshake overhead too. YMMV of course, but worth trying out. | ||