Remix.run Logo
reddalo 4 hours ago

Off topic, but I'm always amazed by Archive.md/.is/whatever. To this day I don't understand how they manage to bypass a lot of paywalls.

The mystery about the owner makes it even more intriguing.

amouat 2 hours ago | parent | next [-]

I assume they just pretend to be the Googlebot so the site just gives the text.

dewey a minute ago | parent [-]

Won’t work for any popular site. You can try that easily by using extensions to set the user agent. If you are not checking the public list of IPs that Google publishes for the crawler you are doing it wrong.

jama211 3 hours ago | parent | prev | next [-]

I just assumed they copied it into their own db

moffkalast 2 hours ago | parent | prev [-]

Given to how many people its existence must be incredibly infuriating, it's so odd that it's not being chased down with more haste than pirate bay was. I mean I'm glad it's not, but kinda surprised.