Phrasing LLMs as encouraging exploitation is important, because they can still be powerful tools for exploration. The difference comes in the interface for LLMs, which is heavily focused on exploitation whereas search engine interfaces encourage exploration.

Newer models often end responses with questions and thoughts that encourage exploration, as do features like ChatGPT's follow up suggestions. However, a lot of work needs to be done with LLM interfaces to balance exploitation and exploration while avoiding limiting AI's capabilities.