Remix.run Logo
ajross 2 days ago

> Do you not see ChatGPT and Claude as viable alternatives to search?

This subthread is classic HN. Huge depth of replies all chiming in to state some form of the original prior: that "AI is a threat to search"...

... without even a nod to the fact that by far the best LLM-assisted search experience today is available for free at the Google prompt. And it's not even close, really. People are so set in their positions here that they've stopped even attempting to survey the market those opinions are about.

(And yes, I'm biased I guess because they pay me. But to work on firmware and not AI.)

glenstein 2 days ago | parent | next [-]

Like others have noted, I think it's far from obvious that Google's LLM prompt is the best experience in the space, I would say it's clearly not in the top tier and even that relatively speaking, I consider it bad compared to the best options.

Assuming we're talking about the AI generated blurbs at the top of search results, there are loads of problems. For one they frequently don't load at all. For another search is an awkward place for them to be. I interact with search differently than with a chat interface where you're embedding a query in a kind of conversational context such that both your query and the answer are rich in contextual meaning. With search I'm typically more fact finding and in a fight against Google's page rank optimizations to try and break through to get my information I need. In a search context AI prompts don't benefit from context rich prompts and aren't able to give context-rich answers and kind of give generic background that isn't necessarily what I asked for. To really benefit from the search prompts I would have to be using the search bar in a prompt way, which would likely degrade the search results. And generally this hybrid interaction is not very natural or easy to optimize, and we all know nobody is asking for it, it's just bolted on to neutralize the temptation to leave search behind in favor of an LLM chat.

And though less important, material design as applied to Google web sites in the browser is not good design, it's ugly and the wrong way to have a prompt interaction. This is also the case for Gemini from a web browser. Meanwhile GPT and Claude are a bit more comfortable with information density and are better visual and interactive experiences because of it.

brookst 2 days ago | parent | prev | next [-]

If Google went all-in on the AI overview and removed search results and invested more heavily in compute, it could be pretty good.

But as it stands, it's a terrible user experience. It's ugly, the page remains incredibly busy and distracting, and it is wrong far more often than ChatGPT (presumably because of inference cost at that scale).

It might be good enough to slow the bleeding and keep less demanding users on SERP, but it is not good enough to compete for new users.

socksy 2 days ago | parent | prev | next [-]

What? The Google LLM assisted search experience is... not the best option by a long shot? It's laughably incorrect in many cases, and infuriatingly incorrect in the others. It forces itself into your queries above the fold without being asked, and then bullshits to you.

A recentish example, I was trying to remember which cities' buses were in Thessaloniki before they got a new batch recently. They used to rent from a company (Papadakis Bros) that would buy out of commission buses from other cities around the world and maintain the fleet. I could remember specifically that there were some BVG Busses from Berlin, and some Dutch buses, and was vaguely wondering if there were some also from Stockholm I couldn't remember.

So I searched on my iPad, which defaulted to Google (since clearly I hadn't got around to setting up a good search engine on it yet). And I get this result: https://i.imgur.com/pm512HU.jpeg

The LLM forced its way in there without me prompting (in e.g. Kagi, you opt in by ending the query with a question mark). It fundamentally misunderstands the question. It then treats me like an idiot for not understanding that Stockholm is a city in Sweden, and Thessaloniki a city in Greece. It uses its back linking functionality to help cite this great insight. And it takes up the entire page! There's not a single search result in view.

This is such a painful experience, it confirms my existing bias that since they introduced LLMs (and honestly for a couple years before that) that Google is no longer a good first place to go for information. It's more of a last resort.

Both ChatGPT and Claude have a free tier, and the ability to do searches. Here's what ChatGPT gave me: https://chatgpt.com/share/68b78eb7-d7b4-8006-81e0-ab2c548931...

A lot of casual users don't hit the free tier limits (and indeedI've not hit any limits on the free ChatGPT yet), and while they have their problems they're both far better than the Gemini powered summaries Google have been pumping out. My suggestion is that perhaps you haven't surveyed the market before suggesting that "by far the best LLM-assisted search experience today is available for free at the Google prompt".

codethief 2 days ago | parent | next [-]

> The LLM forced its way in there without me prompting

I agree this is annoying but other than that I really can't follow your argument: You're comparing a keyword-like "prompt" given to Google's LLM to a well-phrased question given to ChatGPT and are surprised the former doesn't produce the same results?

ajross 2 days ago | parent | prev [-]

It's so frustrating the way AI argumentation goes. People will cherry pick outrageously specific items and extend to crazy generalization. I mean... your phrasing was 100% ambiguous! There's no such thing as a "Stockholm bus", or "Stockholm rolling stock".

There are buses in Stockholm, and buses in Thessoloniki, and buses manufactured in Sweden, and buses previously used in Stockholm that are now in operation in Thessoloniki. And one LLM took one path through the question, answering it correctly and completely. And the other took a different one[1]. As it happened your (poorly phrased) intended question was answered by one and not the other.

If I ask the same question with a more careful phrasing that (I think!) matches what you wanted to know: "Where did buses used in Thessoloniki come from originally?"

...I get correct and clear answers from both. But the Google result also has the Wikipedia page for the transit operator and its own web page immediately to the right.

Again, cherry picking notwithstanding I think in general the integrated experience of "I need an AI to help me with this problem" works much better at google.com, it just does.

[1] It's worth pointing out that the result actually told you that your question didn't make sense, and why. I suspect you think this was a bug since the other LLM guessed instead, but it smells like a feature to me.

liveoneggs 2 days ago | parent | prev | next [-]

Just like google cloud is the best ;)

rs186 2 days ago | parent | prev [-]

I have seen way more hallucination from "AI overview" than ChatGPT.

You are biased, sure, but it seems that you haven't even used ChatGPT or other similar products enough to even attempt to give a fair assessment.

zargon 2 days ago | parent [-]

I'm not sure I have ever seen "AI overview" not hallucinate. Granted, I only end up at google on other people's computers or on some fresh install where I haven't configured search yet.

ajross 2 days ago | parent [-]

> Granted, I only end up at google on other people's computers or on some fresh install where I haven't configured search yet.

Which is exactly my point. A bunch of people doing that to conform with the shibboleth identity of the phone in their pocket and then posting strong opinions about the product they don't (or at least claim not to) use is an echo chamber and not a discussion. You only get the upvotes in these threads if you conform.

HN is supposed to be better than that.

zargon 2 days ago | parent [-]

> the shibboleth identity of the phone in their pocket

Someone here has religion, and it’s not me. I don’t use Google search because it’s a terrible product and we finally have other options. As for AI, there are dozens of options, and it does not take many examples to see how bad Ai Overview is. Gemini 2.5 Pro, however, is in my tool belt.

ajross a day ago | parent [-]

> I don’t use Google search [...]

I know. But you're posting confidently (along with a ton of other people) in a subthread about Google search anyway, making statements about its behavior which you straight up admit to be unqualified to make. And I'm calling out the disconnect, because someone has to.

No one in an echo chamber thinks they're in an echo chamber. This is 100% an echo chamber.

Karrot_Kream a day ago | parent | next [-]

I gave up contributing to these threads years ago. On the edutainment scale HN threads on search have long tipped over to the "entertainment" side. Most of these threads are for people to performatively sneer at ads, javascript, the web, normies etc. HN just can't have conversation about search in a realistic way anymore.

zargon a day ago | parent | prev [-]

The absurdity of this argument speaks for itself. "You're unqualified to judge it because it's so bad you can't tolerate using it."

I suffered through Google search's decline for the last 15 years along with everyone else. I land on it often enough still to see that the trend is not changing.