I'm talking about the scenario the GP referenced — where if you search for say "holiday" but get no results because the pages only use the word "vacation" which AFAIK is still a problem in regular search.

LLMs inherently would introduce the possibility of hallucinations, but just using the vectors to match documents wouldn't, right?

No, llms still use similarity search for candidate generation, unless you don't give them any tools.