Remix.run Logo
nojs 3 days ago

Charge site owners to protect the site from aggressive crawlers, charge crawlers/agents to bypass the protection. Like a good old fashioned protection racket

paxys 3 days ago | parent | next [-]

That's not what protection racket means. Cloudflare isn't the one building LLMs and scraping websites.

3 days ago | parent [-]
[deleted]
josefresco 3 days ago | parent | prev | next [-]

I guess it would be if Cloudflare was operating the bots.

3 days ago | parent | next [-]
[deleted]
mritchie712 3 days ago | parent | prev [-]

huh? they can block the bots

abirch 3 days ago | parent [-]

Usually the protection racket (https://en.wikipedia.org/wiki/Protection_racket) is when the people who will cause the destruction charge to prevent it from happening.

Paying a security guard isn't considered a protection racket, while paying a member of the mob so that nothing happens to my store is considered a protection racket.

nojs 2 days ago | parent [-]

What do you call it when the same security guard also gets paid by the attackers to let them in?

tofuziggy 3 days ago | parent | prev [-]

Charge crawlers and pay site owners, and take a cut of course

riedel 3 days ago | parent [-]

Thanks for the tl;dr . Why is this blog post so long? Will they charge per token?