That's not my point.

Thanks to AI crawlers the traffic costs will rise and all the sites who were ad free either need additional income, most likely ads, or will shut down.

Services like CloudFlare are offering better services all of the time to block web crawlers.