In my experience, 80% of the links it provides are either 404, or go to a thread on a forum that is completely unrelated to the subject.

Im also someone who refuses to pay for it, so maybe the paid versions do better. who knows.

▲

cout 4 days ago | parent | next [-]

The 404 links are truly bizarre. Nearly every link to github.com seems to be 404. That seems like something that should be trivial for a tool to verify.

▲

weatherlite 4 days ago | parent | next [-]

> The 404 links are truly bizarre. Nearly every link to github.com seems to be 404. That seems like something that should be trivial for a tool to verify. reply

Same issue with Gemini. Intuitively I'd also assume it's trivial to fix but perhaps there's more going on than we think. Perhaps validating every part of a response is a big overhead both financially and might even throw off the model and make it less accurate in other ways.

▲

platevoltage 4 days ago | parent | prev [-]

Yeah. The fact that I can't ask ChatGPT for a source makes the tool way less useful. It will straight up say "I verified all of these links" too.

▲

mh- 4 days ago | parent [-]

As you identified, not paying for it is a big part of the issue.

Running these things is expensive, and they're just not serving the same experience to non-paying users.

One could argue this is a bad idea on their part, letting people get a bad taste of an inferior product. And I wouldn't disagree, but I don't know what a sustainable alternative approach is.

▲

xigoi 4 days ago | parent | next [-]

Surely the cost of sending a few HTTP requests and seeing if they 404 is negligible compared to AI inference.

▲

platevoltage 3 days ago | parent | prev [-]

I would have no issue if the free version of ChatGPT told me straight up “You gotta pay for links and sources”. It doesn’t do that.

	▲	mh- 14 hours ago \| parent [-]
		100% agree with that, as I alluded to in my last sentence. And that honestly seems like it might be a good product strategy in the short term.

▲

mkozlows 4 days ago | parent | prev [-]

That's a thing I've experienced, but not remotely at 80% levels.

	▲	platevoltage 3 days ago \| parent [-]
		It might have been the subject I was researching being insanely niche. I was using it to help me fix an arcade CRT monitor from the 80’s that wasn’t found in many cabinets that made it to the USA. It would spit out numbers that weren’t on the schematic, so I asked for context.