Remix clone Hacker News

new | show | ask | jobs Github

▲

pdonis 4 hours ago

> I don’t want to stop the bots from updating their knowledge based on all the content.

Why not? At this point, any attempt to try to meet the bots halfway is doomed.

▲

Demiurge 3 hours ago | parent [-]

Because I also use AI, and I actually want the content from the site to show up for me, as well as other AI users.

More over, I actually pay for three different AI subscriptions, and use them a lot. I also think it’s fair that I pay for their services. I just want them to also pay for what they use.

	▲	mbirth 3 hours ago \| parent [-]
		If these were actual legitimate bots using a known user-agent and coming from the same subnet so you could throttle their requests it would be fine. But I’m seeing requests coming in from random IP addresses from all over the world using randomised user-agents. But somehow these are trying URLs in sequential order. A while ago this would be classed as a DDoS cyber attack.