| ▲ | eru 4 hours ago | |
LLM output is literally randomly sampled. I think what you might want to say is that LLM output is not uniformly random? Or what am I misunderstanding? | ||
| ▲ | swid 4 hours ago | parent | next [-] | |
If I roll a die, it is randomly sampled, but I will always get 1-6, and that is intended by the person who made the die. | ||
| ▲ | patcon 4 hours ago | parent | prev [-] | |
I think they're pointing to the fact that RLHF means that the intention is from humans and not random. I'm not sure if it's their intent, but I wonder if one could still consider these artifacts as "intentional", but not individual attention creating them, and rather an aggregate, soupy collective attention. Obviously, important signal in the human experience is lost there, and we get a soupy middling sort of creation. But it's not random, as I believe the parent was pointing out. EDIT: overall, I align with the article. am just thinking aloud about the contrarian positions, though not committed to them | ||