| ▲ | lysace 4 hours ago | |||||||
At some point they must become more cost efficient by pure market economics mechanisms. That implies less load on sites. Much of the scraping that I see is still very dumb/repetative. Like Googlebot in like 2001. (Blocking Chinese IP ranges with the help of some geoip db helps a lot in the short term. Azure as a whole is the second largest source of pure idiocy.) | ||||||||
| ▲ | incompatible 4 hours ago | parent [-] | |||||||
They seem to have so much bubble money at the moment that the cost of scraping is probably a rounding error in their pocket change. | ||||||||
| ||||||||