Remix.run Logo
bingo-bongo 9 hours ago

AI companies scrape to:

- have data to train on

- update the data more or less continuously

- answer queries from users on the fly

With a lot of AI companies, that generates a lot of scraping. Also, some of them behave terribly when scraping or is just bad at it.

adastra22 9 hours ago | parent [-]

Why don’t they scrape once though?

blell 9 hours ago | parent [-]

1) It may be out of date 2) Storing it costs money