Remix.run Logo
▲ jon128 an hour ago

> They can't "async" their way out of that work.

Sharing cookies along a strata of inter-team bots is one trick.

_

Web scraping is (among the other pieces) also for the more technically inclined among the "little people" to have computers do things that people they don't have the money to hire might do. Making web scraping more difficult, which won't stop the big players who will work around the hurdles one way or another, is "pulling up the ladder".

_

> What alternative web could change this state of things?

A different architecture for trafficking web contents, one that doesn't need the "shield" of something like Cloudflare or "tar pit" of something like Anubis in the first place.

IPFS is or is something like one piece of that picture but there are other essential pieces to complete that picture.