I feel at this point you'd almost be better off hand-curating a set of domains and only crawl those.

not sure if this was intentional, but everything old is new again; back to OH yahoo? or Craig's list?

	▲	graemep 2 hours ago \| parent [-]
		Not quite, in that you can curate domains but crawl all the urls on those domains. I think SEO plam + AI slop is likely to lead us back to human curation.