| ▲ | mystraline an hour ago | |
https://news.ycombinator.com/item?id=46681454 I think this is a recent change. | ||
| ▲ | daveoc64 an hour ago | parent [-] | |
All the comments there seem to suggest that there has been no change and that robots.txt isn't required. | ||
| ▲ | mystraline an hour ago | |
https://news.ycombinator.com/item?id=46681454 I think this is a recent change. | ||
| ▲ | daveoc64 an hour ago | parent [-] | |
All the comments there seem to suggest that there has been no change and that robots.txt isn't required. | ||