Cloudflare is also great at playing both sides, and they're trying pretty hard to push for pay-to-crawl because they'll probably get a 30% cut along the way.

That’s definitely pretty annoying, it’s almost like the walled gardens scenario. I wish this could be more democratized.