Remix.run Logo
nomel 3 hours ago

> from Reddit threads

Google is the only search engine allowed to index Reddit [1].

[1] https://www.lifewire.com/google-reddit-deal-8685766

elliotec 2 hours ago | parent | next [-]

Kagi has tons of results from Reddit and they're always high and relevant. I don't know if this means they're doing it even though they're "not allowed to" or what but they definitely get it somehow.

hoppyhoppy2 2 hours ago | parent | next [-]

Kagi's search results (at least used to) include many Google search results mixed in with results from other sources. That used to be explained on Kagi's main webpage, but I don't see it there now. (And I don't know who pays whom for what in that type of arrangement.)

sethops1 an hour ago | parent | prev | next [-]

Kagi sources their search results from Google.

monooso an hour ago | parent [-]

This is false.

Kagi had a post discussing this which made the front page of HN about a month ago [1]:

> Google does not offer a public search API. The only available path is an ad-syndication bundle with no changes to result presentation - the model Startpage uses. Ad syndication is a non-starter for Kagi’s ad-free subscription model.

[1]: https://news.ycombinator.com/item?id=46708678

resfirestar 28 minutes ago | parent | next [-]

For the purposes of the discussion at hand, yes some results do ultimately come from Google, just via third-party SERP providers rather than Kagi paying Google for access since Google doesn't offer their own public API (and neither does Bing anymore).

rpdillon 25 minutes ago | parent | prev [-]

Some very dodgy wording here.

> Because direct licensing isn’t available to us on compatible terms, we - like many others - use third-party API providers for SERP-style results (SERP meaning search engine results page). These providers serve major enterprises (according to their websites) including Nvidia, Adobe, Samsung, Stanford, DeepMind, Uber, and the United Nations.

> This is not our preferred solution. We plan to exit it as soon as direct, contractual access becomes available. There is no legitimate, paid path to comprehensive Google or Bing results for a company like Kagi. Our position is clear: open the search index, make it available on FRAND terms, and enable rapid innovation in the marketplace.

https://help.kagi.com/kagi/why-kagi/kagi-vs-google.html

kyleee 2 hours ago | parent | prev [-]

Kagi is probably paying Google for those results?

monooso an hour ago | parent | next [-]

I responded to another comment in this thread with the details, but in summary, no.

See this previous discussion: https://news.ycombinator.com/item?id=46708678

LeonenTheDK 2 hours ago | parent | prev [-]

When that news first went out, the article[0] I read at the time said that Kagi does purchase some of its indexing from Google.

[0] https://www.404media.co/email/4650b997-7cc3-4578-834c-7e663e...

thayne 2 hours ago | parent | prev | next [-]

That sounds like some excellent fodder for an anti-trust suit if you ask me.

alex1138 2 hours ago | parent [-]

It does. Reddit has defined what truth is. Banning r/nonewnormal is merely one part of that

Aurornis 3 hours ago | parent | prev | next [-]

Thanks, that explains Reddit.

I see the same phenomenon on other smaller forums, too, though. DuckDuckGo always feels like it has a smaller database than Google, which isn't really a surprise.

skydhash 2 hours ago | parent [-]

I mostly use a web engine (DDG) to find web sites these days, not content. Then I use the site's search instead or just browse the navigation tree. Make everything simpler.

I much prefer to use scholar.google.com or npmjs.com for research. The URL is already in my history/bookmarks and the scoped query is more useful than the generic websearch.

dheera 2 hours ago | parent | prev [-]

I'm sure Baidu could safely index Reddit if they wanted to.