The expectation should be on the LLM to admit they don’t know the answer rather than blame devs for not allowing crawling.