| ▲ | kibwen 2 hours ago | |||||||
> We found our data in the outputs of their models but who can do anything about it... If the crawlers refuse to voluntarily respect your robots.txt, then you are well within your rights to poison their data. | ||||||||
| ▲ | hajile 2 hours ago | parent [-] | |||||||
robots.txt seems like it should be a legally-binding terms of service which would make them outright copyright infringing. Sue for $180,000 per infringement which should be calculated for each illegal API call. | ||||||||
| ||||||||