Remix.run Logo
qingcharles 8 months ago

I have a bot I wrote to help me with various web tasks that are too tedious manually. I just tested it against this and it says "isbot: false".

edit: looks like it only detects bots that overtly identify themselves as bots, e.g. Googlebot -- it's designed to identify clients, not as some sort of security device

mrweasel 8 months ago | parent | next [-]

The worst bot normally doesn't identify themselves as bots.

A really useful flag would be "isAIBot" so you can tell them to f-off. A colleague returned from SRECon and had been asking around in regards to bots from AI companies and it's getting ridicules. AI companies are just hammering sites left and right, to the point where some are hitting the limits on their deals with hosting companies and transit providers.

And you can't filter them out, because their running on AWS, Azure or GCP IPs and aren't identifying themselves properly.

cynicalsecurity 8 months ago | parent [-]

Why allow free and unrestricted connections from hosting companies in the first place?

cbolat 8 months ago | parent | prev | next [-]

It has a misleading name, it should be just a user-agent detector, as one cannot identify devices by just looking at user-agent header.

riiii 8 months ago | parent | prev [-]

That flag should be called isKnownBot.