Remix.run Logo
narrator 3 days ago

An LLM is a lossy Borges' Library of Babel

"Though the vast majority of the books in this universe are pure gibberish, the laws of probability dictate that the library also must contain, somewhere, every coherent book ever written, or that might ever be written, and every possible permutation or slightly erroneous version of every one of those books. " -https://en.wikipedia.org/wiki/The_Library_of_Babel

RodgerTheGreat 3 days ago | parent [-]

It's a version of the library of babel filtered only to the books which plausibly consist of prose. The set is still incomprehensibly vast, and all the more treacherous for generally being "readable".

dragonwriter 2 days ago | parent [-]

“Biased” more than “filtered”; LLMs, though its harder with the better ones, can, when prompted “right” (or “wrong”, depending on your perspective), produce output that is not plausible prose, though obviously they are crafted to respond to the expected style of prompting with things that are plausible prose.