> Maybe someone runs a search engine that only indexes crawled pages that have a X-Web-Classic header or whatever.

Well, not exactly, but this is the next best thing:

https://www.marginalia.nu/

The author is a HN regular.