Remix.run Logo
dofm 6 hours ago

> There's no real edge to it.

Yes, as if it is in some weird hidden dimensional sense completely uniform.

ETA: suddenly reminded of the Bateson quote about information being “the difference that makes a difference”.

fwip 9 minutes ago | parent [-]

That checks out, right? We're instructing LLMs to choose from the least "surprising" tokens at each step (modulo some temperature). It feels smooth, slippery - no friction to the eyes that glaze over as they skim the text, and no bumps to snag in your memory. Like waking from a dream, recalling only the barest shapes of a few concepts or themes, until it vanishes with your morning coffee.

The examples I've seen of AI music (though I avoid it on principle) seem the same.