I’ve found the complete opposite as recently as last week. When I ask a deep question about a book it will hallucinate whole paragraphs of bogus justification and even invent characters

▲

renewiltord 3 days ago | parent | next [-]

The LLM just working on its own is just generative intelligence. You have to ground it if you want the real stuff. The Kindle app has the text of the book and I'd want it to put that in the LLM context.

▲

idontwantthis 3 days ago | parent [-]

The entire book in the context at once?

▲

furyofantares 3 days ago | parent [-]

That's probably 100k-150k tokens for most novels.

	▲	idontwantthis 3 days ago \| parent [-]
		That’s more reasonable than I thought.

▲

dcre 3 days ago | parent | prev [-]

Did you give it the text of the book and tell it to answer based on that?

▲

idontwantthis 3 days ago | parent [-]

Does this feature put the entire text of the book into the context?

	▲	charcircuit 3 days ago \| parent [-]
		I hope not, it probably only goes up to the page you are on in order to avoid spoiling the later content.