| ▲ | golfer 2 hours ago | |
As a site owner, how does one opt out of this, since it obviously ignores robots.txt? | ||
| ▲ | chadwebscraper 2 hours ago | parent [-] | |
Shoot me your site and I can blacklist it | ||
| ▲ | golfer 2 hours ago | |
As a site owner, how does one opt out of this, since it obviously ignores robots.txt? | ||
| ▲ | chadwebscraper 2 hours ago | parent [-] | |
Shoot me your site and I can blacklist it | ||