Interesting to note how similar this seems to what happened with Benj Edwards at Ars Technica. AI was used to extract or summarize information, and quotes found in the summary were then used as source material for the final writing and never double checked against the actual source.

I’ve run into a similar problem myself - working with a big transcript, I asked an AI to pull out passages that related to a certain topic, and only because of oddities in the timestamps extracted did I realize that most of the quotes did not exist in the source at all.

▲

raw_anon_1111 2 hours ago | parent [-]

This seems like a solved problem. Any RAG interface I design I have links to the original source and passage. Even NotebookLM does this.

	▲	mh- 2 hours ago \| parent \| next [-]
		For the curious, the term of art is Grounding. e.g.: https://docs.cloud.google.com/vertex-ai/generative-ai/docs/g...
	▲	tobr an hour ago \| parent \| prev \| next [-]
		It might be a solved problem in the sense that it has a possible solution, but not in the sense that it doesn’t happen with the tools most people would expect to be able to handle the task.
	▲	Peritract 2 hours ago \| parent \| prev [-]
		It was already a solved problem with cmd/ctrl + f.