| ▲ | Zombie stats: Where the numbers AI quotes come from(trakkr.ai) | |||||||||||||||||||||||||||||||||||||
| 48 points by mektrik an hour ago | 13 comments | ||||||||||||||||||||||||||||||||||||||
| ▲ | armcat a minute ago | parent | next [-] | |||||||||||||||||||||||||||||||||||||
There is a human/user element here as well - will the users check the citations, if they are provided inline? I recall in the early ChatGPT web search and Perplexity days, most of the citations didn't work (made up, or 404). You get a false sense of security by having a "[1]" next to the stat or a claim. Maybe labs companies should have some additional quality ranking/checks on these, if it's in their interest of course. | ||||||||||||||||||||||||||||||||||||||
| ▲ | alberth 30 minutes ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||
I know Perplexity isn't often talked about anymore but their design of every sentence needing to be able to be referenced back to an actual source (like an academic peer reviewed paper) seems like a super power for trust. | ||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||
| ▲ | toddmorey 3 minutes ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||
I can't decide if the report's writing ("One number, followed" & "Quoted by all five. Sourced by none.") is being lazy or ironic? | ||||||||||||||||||||||||||||||||||||||
| ▲ | falcor84 37 minutes ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||
A full 40% of AI stats actually have a specific study behind them? Knowing how the human baseline is that 73.6%* of all statistics are made up on the spot, this is really encouraging. *That particular stat was of course made up, but not by me. | ||||||||||||||||||||||||||||||||||||||
| ▲ | brendong 7 minutes ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||
Better to be on the 40% or the 60%? Seems like both sides will bite you in the ass to an extent | ||||||||||||||||||||||||||||||||||||||
| ▲ | jrflo 17 minutes ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||
Just an thinly veiled ad for something called trakkr. Not to mention that none of these "stats" actually matter aside from being the type of thing that a consultant would put in a pitch deck, at which point their accuracy doesn't matter anyways | ||||||||||||||||||||||||||||||||||||||
| ▲ | mfld 15 minutes ago | parent | prev | next [-] | |||||||||||||||||||||||||||||||||||||
Never trust a statistic you haven't sneaked into the training corpus yourself. | ||||||||||||||||||||||||||||||||||||||
| ▲ | zzzeek 17 minutes ago | parent | prev [-] | |||||||||||||||||||||||||||||||||||||
when people say "there should be no AI taught in schools ever. prompting? what skill is there in talking to a liar bot?" this is where they are dead wrong. Being correctly critical of LLM output is a huge skill and news flash it applies to people and human-written things too. | ||||||||||||||||||||||||||||||||||||||