Linkedin, reddit, instagram, pinterest, x, bluesky, threads, facebook... they provide a better experience to web crawlers than logged-out humans.

▲

4 hours ago | parent | next [-]

[deleted]

▲

Telemakhos 3 hours ago | parent | prev [-]

Does this suggest an opportunity (maybe a business opportunity) for a service that, by crawling and scraping paywalled sites, presents to the human user what bots get to see? What if this service could somehow correlate all the socials you mentioned in a single, less horrible user interface?

	▲	akersten 3 hours ago \| parent \| next [-]
		Xcancel before it got cancelled and I doubt anyone would have paid for it anyway
	▲	throwawayffffas 2 hours ago \| parent \| prev \| next [-]
		archive.is, when google served cached pages you could get the actual content from the cache, not sure if other engines still serve the page they crawled as a cache.
	▲	CalRobert 2 hours ago \| parent \| prev \| next [-]
		That’s how paywall unlockers work
	▲	micromacrofoot 3 hours ago \| parent \| prev [-]
		they would all try to sue you and you'd be fighting constant rate limits