I'm not at all in the same boat as you; I do not and likely will never primarily rely on LLMs for information. But it's fascinating to hear that even folks who do don't find this approach useful.

For me, Google search results have gotten so poor (and other engines aren’t any better), that I’d rather just ask an online LLM for what I’m looking for.

I was once very good at advanced Google search queries but they seem to no longer respect such queries - either showing irrelevant results or none at all (that should exist).

I don’t love LLMs, but they seem to not make up stuff very often these days and usually cite links to what they summarized. Sometimes the tone of the summary is slightly wrong “algorithm X was designed for Y” (when I know it wasn’t) but it’s otherwise very close to the mark.

What does amaze me, is the LLM seems to “understand” my question with very little context — I would have to give a human many more details about goals/intent.

I know damn LLMs are not capable of thought and are just a glorified search engine, but they do it well. Perhaps all my education made me little more…

I used to mock Sci-Fi movies where characters lazily dictated questions to the computer and it gave high quality answers.

We’re living in that world now.

LLMs-as-search-proxies have some pretty nice capabilities. For instance you can say "limit your search to scientific papers" and they'll do a much nicer job. I've also had some success recently prompting them with "I'm looking for reputable sources", e.g. recently I was looking for ways to repel deer from my apple tres. A naive internet search had vendors of shady crap jumping me. The LLMs pulled up relevant papers and university extension programs from my area.

Though I will say I get much better results from the LLMs I pay for than the free ones with Google or DuckDuckGo, which seem to be way way way more prone to just make crap up based on your search and cite web pages that, when followed, don't have the claim being made in the AI search results at all. By contrast every "source" link I've followed in the for-money AIs has 100% backed what the AI said it backed. Don't judge by the free AIs the search engines put out, those things are probably starved of resources and are nearly useless.

(Which I did not intend as a commentary on Google's plans here, but it is a data point of interest... that pressure to cut costs on the "free" services is quite directly at odds with providing quality AI services for the forseeable future.)

As someone who was getting information this way most of last year, I'm pretty sure I'll never want to again.

An increasing number of studies are indicating a reliance on "AI" leads to deleterious cognitive effects. I felt this acutely myself.

I've noticed a significant boost to my recall since shunning "AI" as much as possible.

The other day I found a comment here on HN and I wanted to know if it's true. I asked Gemini and here is the conversation https://gemini.google.com/share/2c1089ac6fd6

You can't do something like this with search.

Google has optimized their hardcoded search engine so much for the natural language searches people actually use, that they made it useless as an actual tool for someone who wants to find information. AI jumped over all of that and is BETTER at natural language searches, leaving the google search engine largely useless for anyone.

I think LLMs are better at finding the most helpful sources now, but that's more a testament to how much the front page of web search has lost to low value LLM content.

LLMs are so frequently inaccurate its crazy to think of it fully replacing search.

I've been trying to use LLMs for things and it makes mistakes all the time. Just this week i had multiple instances of various LLMs basically saying "just run the software with --flag-that-fixes-your-problem" or "edit the config and add solve-your-issue=true" hallucinating non-existant options. Even if i manually link the relevant documentation pages it will still just make basic mistakes. and if im having to read the documentation myself anyway to fix the AI's mistakes, why is the AI even in the loop.

its infecting search too, because blogspam/slop articles are managing to make their way into search results by just making up untrue information, claiming software can do things it cant, or has options that don't exist.

I'm not jumping in with both feet, either, but "never" is a very big word.

Search results are 80% SEO low-quality garbage nowadays. Very often, the sites even generate their content with AI. So for many use cases I stopped bothering with search and directly ask LLMs instead.

As a concrete example, some advertising supported topics place search as an unwanted middleman, may as well ask a LLM directly. Consider "chocolate chip cookie recipe".

Using google search, will return roughly infinite recipe sites. The sites were generated to spam AI generated recipes surrounded by advertisements. None of them are really any good because they were generated by a script and not looked at by a human until I come along and click. The standard is for all recipes to have at least 10-15 screenfulls of vertical spam wrapped by ads for recipe pages. The internet, at least using Search, is now useless for food recipes. I would have better, faster luck driving to the public library and looking in a physical cookbook; at least those recipes were probably tested at least once by humans unlike the advertising spam sites. Nobody has 45 minutes to watch 44 minutes of filler material surrounded by ads on Youtube either. If you want to cook food, the internet is near dead at this time, unfortunately.

AI search will plagiarize the "Original Nestle Toll House" recipe from the back of every bag of chocolate chips ever made. Its a good recipe and I've baked them many times over the decades.

I wish the internet were more useful, but the people in charge of it don't want it to be useful; here have some ragebait and doomscroll while watching the ads.

My google use is down because it turned to garbage. They're likely doing this because they poisoned their own well besides the advent of LLMs.

LLM hallucinations are better than Google results these days and I'm not even trying to tell a silly joke. It's more useful for an LLM to lie to my face about 10% of my query, be suspicious and dig out that useful information than to try to parse the absolute slop returned by a normal, non-AI Google query.

I don't comprehend how the average person gets any useful information out of Google.