| ▲ | PunchyHamster 3 hours ago | |
Given that the scraping doesn't do any rate limiting and pisses on robots.txt, yes it is abuse | ||
| ▲ | singpolyma3 2 hours ago | parent [-] | |
Is there any evidence OpenAI has been ignoring robots.txt for scraping purposes? AFAIK the main sources of that traffic are still unknown. | ||