| ▲ | jalict 3 hours ago | |
This is quite simple put in the article. > The crawler did not respect our robots.txt, (which it did retrieve), ignored our Terms of Service, (which forbid scraping), and defied the creators' licenses: 423 of the 712 projects are licensed for non-commercial use only. | ||
| ▲ | bsenftner 3 hours ago | parent | next [-] | |
A robots.txt file is not anything, not enforceable, it's politeness. Of course it was ignored. | ||
| ▲ | fg137 3 hours ago | parent | prev | next [-] | |
That fight was already lost back in 2024. | ||
| ▲ | ForHackernews 2 hours ago | parent | prev [-] | |
Sue them. They'd sue you for ignoring their ToS. | ||