Remix.run Logo
jackienotchan an hour ago

Congrats! Could this also be used to generate e2e test automations?

For scraping, how do you handle Cloudflare and Captchas? Do you respect robots.txt instructions of websites?

cschlaepfer an hour ago | parent [-]

Thanks, we appreciate it!

Yes, you can use BrowserBook to write e2e test automations, but we don't currently include playwright assertions in the runtime - we excluded these since they are geared toward a specific use case, and we wanted to build more generally. Let us know if you think we should include this though; we're always looking for feedback.

> For scraping, how do you handle Cloudflare and Captchas?

Cloudflare turnstiles/captchas tend to be less of an issue in the inline browser because it’s just a local Chrome instance, avoiding the usual bot-detection flags from headless or cloud browsers (datacenter IPs, user-agent quirks, etc.). For hosted browsers, we use Kernel's stealth mode to similar effect.

> Do you respect robots.txt instructions of websites?

We leave this up to the developer creating the automations.