Remix.run Logo
▲ tkdb 9 hours ago

LLMs are facing the same problem pre-google humans faced:

Is this information on this website true/high quality?

We need a google for LLMs!

Oh, but LLMs don't consume ads.

We need ads for LLMs!

Help.

▲piokoch 8 hours ago | parent [-]

Pre Google internet problem was not about the quality but about spam in headers and keywords, which were used by the pre-google search engines.

Google came and worked wonderfully for a year or two, until people learned to game page rank algorithm. Soon first google pages were just SEO spam and now half of the google is just spam, big corp websites, etc.

All of that precious stuff from small hobby websites about cool things to blogs that used to be wonderful read like https://www.joelonsoftware.com.

AI were not hurt that much by spam, I guess there were at least some curation done, the question is if this curation will work and for how long. It seems we are throwing the towel here as in case of search.

▲tkdb 4 hours ago | parent [-]

I mean - pre google had the problem of "these two webpages are both about how to take care of your dog, but which one is higher quality?"

Backlink ranking was/is a reliable heuristic to answer that question across virtually all topics.

So I disagree that the "problem was not about quality."

Spam/scammers will always be in whatever landscape there is, and I agree part of what google does it keep them at bay.