| ▲ | messe 3 hours ago | |
> It's not about bypassing access restrictions. Yes. It is. You've just made an arbitrary choice not to define it as such. | ||
| ▲ | andrew_zhong 2 hours ago | parent [-] | |
I will add a PR to enforce robots.txt before the actual scraping. | ||
| ▲ | messe 3 hours ago | |
> It's not about bypassing access restrictions. Yes. It is. You've just made an arbitrary choice not to define it as such. | ||
| ▲ | andrew_zhong 2 hours ago | parent [-] | |
I will add a PR to enforce robots.txt before the actual scraping. | ||