Anyone can leverage common crawl and/or run their own crawler, to do so isn’t novel.

https://commoncrawl.org/