▲ | mattigames 2 days ago | ||||||||||||||||||||||||||||||||||
Yeah no, nothing of that helps you bypass the ads on their website*, but scraping and summarizing does, so its wildly different for monetization purposes, and in most cases that means the maintainability and survival of any given website. I know its not completely true, I know reader mode can help you bypass the ads _after_ you already had a peek at the cluttered version, but if you need to go to the next page or something like that you need to disable reader-mode once and so on, so its a very granular ad-blocking while many AI use cases are about bypassing viewing it at all by a human; and the other thing is that reader mode is not very popular so its not a significant threat. *or other links on their websites, or informative banners, etc | |||||||||||||||||||||||||||||||||||
▲ | debazel 2 days ago | parent | next [-] | ||||||||||||||||||||||||||||||||||
robots.txt is not there to protect your ad-based business model. It's meant for automated scrapers that recursively retrieve all pages on your website, which this browser is not doing at all. What a user does with a page after it has entered their browser is their own prerogative. | |||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||
▲ | lolinder 2 days ago | parent | prev | next [-] | ||||||||||||||||||||||||||||||||||
> I know its not completely true, I know read-mode can help you bypass the ads _after_ you already had a peek at the cluttered version What about reader mode that is auto-configured to turn on immediately on landing on specific domains? Is that a robot for the purposes of robots.txt? https://addons.mozilla.org/en-US/firefox/addon/automatic-rea... And also, just to confirm, I'm to understand that if I'm navigating the internet with an ad blocker then you believe that I should respect robots.txt because my user agent is now a robot by virtue of using an ad blocker? Is that also true if I browse with a terminal-based browser that simply doesn't render JavaScript or images? | |||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||
▲ | 2 days ago | parent | prev [-] | ||||||||||||||||||||||||||||||||||
[deleted] |