Remix.run Logo
phdelightful 3 hours ago

I just put Anubis in front of my self-hosted forge this morning because AmazonBot had helped itself to 750 GiB (!) of traffic to my public repos this month!

At least, it claimed to be AmazonBot…

Bender 2 hours ago | parent | next [-]

Are they in this space? [1] One could map the ranges into a web daemon and rate limit them or just 'ip route add blackhole ${cidr}' each cidr block.

[1] - https://ip-ranges.amazonaws.com/ip-ranges.json

nathanmills 3 hours ago | parent | prev [-]

Do you have a robots.txt?

xena 3 hours ago | parent [-]

> We are writing to inform you that starting Monday, June 15, 2026, crawl preferences for Amazonbot will be managed solely through the industry-standard directives.

They will in the future, but not today.