Remix.run Logo
tonyhart7 2 hours ago

I mean this AI data scrapper would need to scan and fetch billions of website

why would they even care over 1 single website ??? You expect instiution to care out of billions website they must scrape daily

what an hour ago | parent [-]

This is probably the reason. It’s more effort to special case every site that offers dumps than to just unleash your generic scraper on it.