The "LLM giants" do both. They have to create an index to know which pages to even fetch in the first place. A simple web search does not actually necessarily hit any pages it's only when it does a page fetch based on that search