Remix.run Logo
▲ lukan 2 hours ago

Logic says google bots do not come disguised, but as google agents.

Or is there other information?

Now there is probably also AI agent spam from google, but not at this level I believe. Also I am not fully clear what they count as spam, I doubt they would include google in this list, so do they include yandex bots here, if they come officially?

▲selcuka 15 minutes ago | parent | next [-]

Google bots definitely come disguised, to check whether the web site serves different content to non-Google user agents.

▲walrus01 9 minutes ago | parent [-]

There's also the very well known inverse phenomenon of absolutely non-google people trying to disguise their crawler as a googlebot useragent, which has been a thing since at least... 15 years now?

▲konart 2 hours ago | parent | prev | next [-]

Neither do Yandex bots. What's your point?

▲lukan 2 hours ago | parent [-]

If official yandex bots ain't included in this data here - then it means spam/scam bots come indeed from yandex servers. As they stopped working, when the yandex data center was hit.

▲asdfsa32 2 hours ago | parent | next [-]

But what do you mean by "if"? It is a well defined metric and there is no "if".

▲konart 2 hours ago | parent | prev [-]

I'll just link this comment if I may: https://news.ycombinator.com/item?id=50042416

▲lukan 2 hours ago | parent [-]

Thank you, I missed that one (or it was not there when I started writing).

So yandex bots are included and this metric says nothing about malicious yandex intent here.

▲asdfsa32 2 hours ago | parent | prev [-]

I am unsure what you're trying to say. But it seems like you don't understand what Bot means in general and how is it specifically defined for the metric provided in that page.

From that pages point of view, a Google bot, Yandex bot, or your uncle Tom's AI agent spam is the same, a bot.

▲lukan 2 hours ago | parent [-]

I know what it means in general, but like I said indeed not "how is it specifically defined for the metric provided in that page."