These days I prefer to ask an LLM to just go fetch content for me as much as possible.
How often do they run into anti bot protections?
Vision language models are quite good at solving captchas now :)