It sounds really expensive to run inference as a crawler.