That's fair - though are we in an isolated bout of "every now and then" or has AI created a new normal of abuse (e.g. of robots.txt)? Hopefully we're at a local maximum and some of the scrapers perpetrating harmful behaviours will soon pull their heads in.

Hopefully. It would also be nice to see more activity in the actual search engine and archiving market; there really isn’t much right now.